Apr 13 17:00:16 devstack cinder-volume[72955]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 17:00:16 devstack cinder-volume[72955]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 17:00:16 devstack cinder-volume[72955]: we strongly recommend against using it for new projects.
Apr 13 17:00:16 devstack cinder-volume[72955]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 17:00:16 devstack cinder-volume[72955]: framework.  For more detail see
Apr 13 17:00:16 devstack cinder-volume[72955]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 17:00:16 devstack cinder-volume[72955]:   import eventlet  # noqa
Apr 13 17:00:17 devstack cinder-volume[72955]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 17:00:17 devstack cinder-volume[72955]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 17:00:17 devstack cinder-volume[72955]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO dbcounter [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Registered counter for database cinder
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG oslo_db.sqlalchemy.engines [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG dbcounter [-] [72955] Writer thread running {{(pid=72955) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO cinder.rpc [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO cinder.rpc [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG oslo_db.sqlalchemy.engines [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO cinder.volume.manager [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Determined volume DB was empty at startup.
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG cinder.volume.manager [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72955) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO cinder.volume.manager [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 17:00:18 devstack cinder-volume[72955]: WARNING stevedore.named [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 17:00:18 devstack cinder-volume[72955]: WARNING castellan.key_manager [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 17:00:18 devstack cinder-volume[72955]: WARNING cinder.keymgr.conf_key_mgr [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG cinder.volume.drivers.lvm [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72955) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG oslo_concurrency.processutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG oslo_concurrency.processutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] CMD "cinder-rtstool verify" returned: 0 in 0.233s {{(pid=72955) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG oslo_db.sqlalchemy.engines [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO cinder.rpc [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO cinder.rpc [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 13 17:00:18 devstack cinder-volume[72955]: WARNING stevedore.named [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 17:00:18 devstack cinder-volume[72955]: WARNING castellan.key_manager [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO cinder.volume.manager [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 13 17:00:18 devstack cinder-volume[72955]: DEBUG oslo_db.sqlalchemy.engines [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72955) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:00:18 devstack cinder-volume[72955]: INFO oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Starting 1 workers
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Started child 73059 {{(pid=72955) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Full set of CONF: {{(pid=72955) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] ******************************************************************************** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Configuration options gathered from: {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] ================================================================================ {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 17:00:19 devstack cinder-volume[73059]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] allow_availability_zone_fallback = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] allow_compression_on_image_upload = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] allowed_direct_url_schemes     = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] api_rate_limit                 = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] auth_strategy                  = keystone {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] az_cache_duration              = 3600 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_availability_zone      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_host                   = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_name                   = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_stats_polling_interval = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backup_api_class               = cinder.backup.api.API {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backup_name_template           = backup-%s {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backup_use_same_host           = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backup_use_temp_snapshot       = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] chap_password                  = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] chap_username                  =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_internal_tenant_project_id = f461f32c4add4f34a503091b11836f1c {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_internal_tenant_user_id = 16002f9dee864a57ae1685d0cbd9c59f {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cloned_volume_same_az          = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cluster                        = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] compression_format             = gzip {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] config_dir                     = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] config_source                  = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] control_exchange               = openstack {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] debug                          = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] default_availability_zone      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] default_group_type             = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] default_volume_type            = lvmdriver-1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] disk_geometry                  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] driver_client_cert             = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] driver_client_cert_key         = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] driver_data_namespace          = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] driver_ssl_cert_path           = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] driver_ssl_cert_verify         = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] driver_use_ssl                 = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] enable_force_upload            = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] enable_new_services            = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] enable_unsupported_driver      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] enforce_multipath_for_image_xfer = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] filter_function                = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_api_insecure            = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_api_servers             = ['http://192.168.122.196/image'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_api_ssl_compression     = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_ca_certificates_file    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_certfile                = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_keyfile                 = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_num_retries             = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance_request_timeout         = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] goodness_function              = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] graceful_shutdown_timeout      = 5 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] group_api_class                = cinder.group.api.API {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] host                           = devstack {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_compress_on_upload       = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_conversion_address_space_limit = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_conversion_cpu_limit     = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_conversion_disable       = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_upload_use_cinder_backend = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_upload_use_internal_tenant = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_volume_cache_enabled     = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_volume_cache_max_count   = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] image_volume_cache_max_size_gb = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] init_host_max_objects_retrieval = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] iscsi_target_flags             =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] iscsi_write_cache              = on {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] iser_helper                    = tgtadm {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] iser_ip_address                = 192.168.122.196 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] iser_port                      = 3260 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_color                      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_config_append              = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_dir                        = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_file                       = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_options                    = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_rotate_interval            = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_rotate_interval_type       = days {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] log_rotation_type              = none {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] max_age                        = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] max_logfile_count              = 30 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] max_logfile_size_mb            = 200 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] max_over_subscription_ratio    = 20.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] message_reap_interval          = 86400 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] message_ttl                    = 2592000 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] migration_create_volume_timeout_secs = 300 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] monkey_patch                   = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] monkey_patch_modules           = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] my_ip                          = 192.168.122.196 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] no_snapshot_gb_quota           = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] num_iser_scan_tries            = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] num_shell_tries                = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] num_volume_device_scan_tries   = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] nvmeof_conn_info_version       = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] nvmet_ns_id                    = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] nvmet_port_id                  = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] osapi_max_limit                = 1000 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] osapi_volume_ext_list          = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] osapi_volume_listen_port       = 8776 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] osapi_volume_use_ssl           = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] osapi_volume_workers           = 2 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] per_volume_size_limit          = -1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] periodic_fuzzy_delay           = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] periodic_interval              = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] public_endpoint                = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] publish_errors                 = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] quota_backup_gigabytes         = 1000 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] quota_backups                  = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] quota_gigabytes                = 1000 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] quota_groups                   = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] quota_snapshots                = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] quota_volumes                  = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] rate_limit_burst               = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] rate_limit_except_level        = CRITICAL {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] rate_limit_interval            = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] reinit_driver_count            = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] replication_device             = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] report_discard_supported       = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] report_interval                = 120 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] reservation_clean_interval     = 86400 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] reservation_expire             = 86400 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] reserved_image_namespaces      = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] reserved_percentage            = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] rpc_response_timeout           = 120 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] run_external_periodic_tasks    = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] scst_target_driver             = iscsi {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] scst_target_iqn_name           = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_down_time              = 720 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] shell_completion               = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] snapshot_name_template         = snapshot-%s {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] snapshot_same_host             = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] split_loggers                  = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] state_path                     = /opt/stack/data/cinder {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] storage_availability_zone      = nova {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] storage_protocol               = iSCSI {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] syslog_log_facility            = LOG_USER {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] target_helper                  = lioadm {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] target_ip_address              = 192.168.122.196 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] target_port                    = 3260 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] target_protocol                = iscsi {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] target_secondary_ip_addresses  = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] trace_flags                    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] transport_url                  = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] until_refresh                  = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] use_chap_auth                  = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] use_default_quota_class        = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] use_journal                    = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] use_json                       = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] use_multipath_for_image_xfer   = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] use_stderr                     = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] use_syslog                     = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] verify_glance_signatures       = enabled {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_api_class               = cinder.volume.api.API {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_backend_name            = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_clear                   = zero {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_clear_ionice            = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_clear_size              = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_copy_bps_limit          = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_dd_blocksize            = 1M {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_name_template           = volume-%s {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_service_inithost_offload = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volume_usage_audit_period      = month {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] zoning_mode                    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_concurrency.disable_process_locking = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.admin_password = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.admin_token = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.admin_user  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_protocol = https {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_section = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_type   = password {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_uri    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.auth_version = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.cache       = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.certfile    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.identity_uri = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.include_service_catalog = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.insecure    = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.interface   = public {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.keyfile     = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_password =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[73059]: INFO cinder.volume.manager [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcache_username =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.region_name = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.service_type = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.backend                  = dogpile.cache.null {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.backend_argument         = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.backend_expiration_time  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.config_prefix            = cache.oslo {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.debug_cache_backend      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.enable_retry_client      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.enable_socket_keepalive  = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.enabled                  = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.enforce_fips_mode        = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.expiration_time          = 600 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.hashclient_retry_attempts = 2 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.memcache_dead_retry      = 300 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.memcache_sasl_enabled    = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.password                 = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.proxies                  = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.redis_db                 = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.redis_server             = localhost:6379 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.retry_attempts           = 2 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.retry_delay              = 0.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.socket_keepalive_count   = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.socket_keepalive_idle    = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.socket_keepalive_interval = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.socket_timeout           = 1.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.tls_allowed_ciphers      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.tls_cafile               = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.tls_certfile             = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.tls_enabled              = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.tls_keyfile              = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cache.username                 = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] coordination.backend_url       = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.asyncio_connection    = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.asyncio_slave_connection = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.backend               = sqlalchemy {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.connection            = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.connection_debug      = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.connection_parameters =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.connection_recycle_time = 3600 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.connection_trace      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.db_inc_retry_interval = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.db_max_retries        = 20 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.db_max_retry_interval = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.db_retry_interval     = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.max_overflow          = 50 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.max_pool_size         = 5 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.max_retries           = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.mysql_wsrep_sync_wait = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.pool_timeout          = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.retry_interval        = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.slave_connection      = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.sqlite_synchronous    = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.synchronous_reader    = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] database.use_db_reconnect      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.connection_string     = messaging:// {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.enabled               = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.es_doc_type           = notification {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.es_scroll_size        = 10000 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.es_scroll_time        = 2m {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.filter_error_trace    = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.hmac_keys             = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.sentinel_service_name = mymaster {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.socket_timeout        = 0.1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.trace_requests        = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler.trace_sqlalchemy      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler_jaeger.process_tags   = {} {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler_jaeger.service_name_prefix = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] profiler_otlp.service_name_prefix = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.enforce_new_defaults = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: WARNING oslo_config.cfg [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.enforce_scope      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.policy_default_rule = default {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] privsep_osbrick.group          = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] privsep_osbrick.helper_command = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] privsep_osbrick.user           = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_sys_admin.group         = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_sys_admin.helper_command = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] cinder_sys_admin.user          = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.auth_section      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.auth_type         = password {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.cafile            = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.certfile          = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.collect_timing    = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.insecure          = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.keyfile           = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.send_service_user_token = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.split_loggers     = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] service_user.timeout           = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.auth_section            = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.auth_type               = password {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.certfile                = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.collect_timing          = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.insecure                = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.keyfile                 = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.region_name             = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.split_loggers           = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] glance.timeout                 = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.backend_availability_zone = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.chap_password = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.chap_username =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.disk_geometry = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.driver_client_cert = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.driver_client_cert_key = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.driver_data_namespace = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.driver_use_ssl = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.extra_capabilities = {} {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.filter_function = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.goodness_function = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.iscsi_target_flags =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.iscsi_write_cache = on {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.iser_port     = 3260 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.lvm_share_target = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.lvm_type      = auto {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.num_shell_tries = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.replication_device = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.report_discard_supported = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.reserved_percentage = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.target_helper = tgtadm {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.target_port   = 3260 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.target_protocol = iscsi {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.trace_flags   = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.unique_fqdn_network = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.use_chap_auth = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_backend_name = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_clear  = zero {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_clear_ionice = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_clear_size = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_reports.file_event_handler = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_reports.log_dir           = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.backend_host       = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.chap_password      = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.chap_username      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.disk_geometry      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.driver_client_cert = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.extra_capabilities = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.filter_function    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.goodness_function  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.iser_helper        = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.iser_port          = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.lvm_type           = auto {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.replication_device = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.report_discard_supported = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.reserved_percentage = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.scst_target_driver = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.storage_protocol   = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.target_ip_address  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.target_port        = 3260 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.trace_flags        = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_clear       = zero {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] lvmdriver-1.volumes_dir        = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_notifications.driver = [] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_notifications.retry = -1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] key_manager.fixed_key          = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.barbican_api_version  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.barbican_endpoint     = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.barbican_endpoint_type = public {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.barbican_region_name  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.cafile                = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.certfile              = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.collect_timing        = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.insecure              = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.keyfile               = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.number_of_retries     = 60 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.retry_delay           = 1 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.send_service_user_token = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.split_loggers         = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.timeout               = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.verify_ssl            = True {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican.verify_ssl_path       = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.auth_section = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.auth_type = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.cafile   = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.certfile = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.collect_timing = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.insecure = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.keyfile  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.split_loggers = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] barbican_service_user.timeout  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.approle_role_id          = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.approle_secret_id        = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.kv_mountpoint            = secret {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.kv_path                  = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.kv_version               = 2 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.namespace                = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.root_token_id            = **** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.ssl_ca_crt_file          = None {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.timeout                  = 60.0 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.use_ssl                  = False {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:00:19 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] ******************************************************************************** {{(pid=72955) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.060s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:19 devstack sudo[73063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 13 17:00:19 devstack sudo[73063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:19 devstack sudo[73063]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.553s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:19 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:19 devstack sudo[73151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:19 devstack sudo[73151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:20 devstack sudo[73151]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.512s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:00:20 devstack cinder-volume[73059]: INFO cinder.brick.local_dev.lvm [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:20 devstack sudo[73408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:00:20 devstack sudo[73408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:20 devstack sudo[73408]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG cinder.brick.local_dev.lvm [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73059) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 13 17:00:20 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:20 devstack sudo[73584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:20 devstack sudo[73584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:21 devstack sudo[73584]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:21 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.894s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:21 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:21 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:21 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:21 devstack sudo[73745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:21 devstack sudo[73745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:22 devstack sudo[73745]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:22 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:22 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:22 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:22 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:22 devstack sudo[73758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 13 17:00:22 devstack sudo[73758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:22 devstack sudo[73758]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:22 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.434s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:22 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:22 devstack sudo[73764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:00:22 devstack sudo[73764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:23 devstack sudo[73764]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:23 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:23 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:23 devstack sudo[73769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:00:23 devstack sudo[73769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:23 devstack sudo[73769]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:23 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:23 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:23 devstack sudo[73772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:00:23 devstack sudo[73772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:24 devstack sudo[73772]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:24 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:24 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:24 devstack sudo[73777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:24 devstack sudo[73777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:24 devstack sudo[73777]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:24 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:24 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:24 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:24 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:24 devstack sudo[73784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:24 devstack sudo[73784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:25 devstack sudo[73784]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:25 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.581s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:25 devstack cinder-volume[73059]: INFO cinder.volume.drivers.lvm [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 13 17:00:25 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:25 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:25 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:25 devstack sudo[73846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:25 devstack sudo[73846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:25 devstack sudo[73846]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:25 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:25 devstack cinder-volume[73059]: DEBUG cinder.volume.drivers.lvm [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Updating volume stats {{(pid=73059) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 17:00:25 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:25 devstack sudo[73906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:00:25 devstack sudo[73906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:26 devstack sudo[73906]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:26 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.478s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:26 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:26 devstack sudo[74048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:00:26 devstack sudo[74048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:26 devstack sudo[74048]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:26 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:26 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:26 devstack sudo[74051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:26 devstack sudo[74051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:27 devstack sudo[74051]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:27 devstack sudo[74054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:00:27 devstack sudo[74054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:27 devstack sudo[74054]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:27 devstack cinder-volume[73059]: INFO cinder.volume.driver [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG cinder.volume.driver [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73059) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG oslo_db.sqlalchemy.engines [None req-e50df72c-9a17-4659-b927-69237085d42c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73059) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG dbcounter [-] [73059] Writer thread running {{(pid=73059) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG cinder.db.sqlalchemy.api [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Building query based on filter {{(pid=73059) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG cinder.image.image_utils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73059) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 17:00:27 devstack cinder-volume[73059]: INFO cinder.keymgr.migration [None req-35c3ed48-0fd4-479d-aa19-37ee53fd76c6 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG cinder.volume.drivers.lvm [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Updating volume stats {{(pid=73059) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 17:00:27 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:27 devstack sudo[74059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:00:27 devstack sudo[74059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:28 devstack sudo[74059]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:28 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:28 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:28 devstack sudo[74065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:00:28 devstack sudo[74065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:28 devstack sudo[74065]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:28 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:28 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:28 devstack sudo[74071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:28 devstack sudo[74071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:28 devstack cinder-volume[72955]: DEBUG dbcounter [-] [72955] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72955) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:00:29 devstack sudo[74071]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.483s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:29 devstack sudo[74078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:00:29 devstack sudo[74078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:29 devstack sudo[74078]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG cinder.manager [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Notifying Schedulers of capabilities ... {{(pid=73059) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:00:29 devstack cinder-volume[73059]: INFO cinder.volume.manager [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Driver initialization completed successfully.
Apr 13 17:00:29 devstack cinder-volume[73059]: INFO cinder.manager [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Initiating service 2 cleanup
Apr 13 17:00:29 devstack cinder-volume[73059]: INFO cinder.manager [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Service 2 cleanup completed.
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG cinder.service [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Creating RPC server for service cinder-volume {{(pid=73059) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG cinder.service [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73059) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 17:00:29 devstack cinder-volume[73059]: INFO cinder.volume.manager [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG cinder.volume.drivers.lvm [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Updating volume stats {{(pid=73059) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 17:00:29 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:29 devstack sudo[74082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:00:29 devstack sudo[74082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:30 devstack sudo[74082]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:30 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:30 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:30 devstack sudo[74142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:00:30 devstack sudo[74142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:30 devstack sudo[74142]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:30 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:30 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:30 devstack sudo[74145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:00:30 devstack sudo[74145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:30 devstack sudo[74145]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:30 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:30 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:00:30 devstack sudo[74148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:00:30 devstack sudo[74148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:00:31 devstack sudo[74148]: pam_unix(sudo:session): session closed for user root
Apr 13 17:00:31 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-e50df72c-9a17-4659-b927-69237085d42c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:00:31 devstack cinder-volume[73059]: INFO cinder.volume.manager [None req-e50df72c-9a17-4659-b927-69237085d42c None None] Driver post RPC initialization completed successfully.
Apr 13 17:00:39 devstack cinder-volume[73059]: DEBUG dbcounter [-] [73059] Writing DB stats cinder:SELECT=3 {{(pid=73059) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:00:41 devstack cinder-volume[73059]: DEBUG dbcounter [-] [73059] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73059) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:01:43 devstack cinder-volume[73059]: DEBUG oslo_service.periodic_task [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73059) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:01:43 devstack cinder-volume[73059]: DEBUG cinder.volume.drivers.lvm [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Updating volume stats {{(pid=73059) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 17:01:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:01:43 devstack sudo[78913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:01:43 devstack sudo[78913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:01:43 devstack sudo[78913]: pam_unix(sudo:session): session closed for user root
Apr 13 17:01:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:01:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:01:43 devstack sudo[78925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:01:43 devstack sudo[78925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:01:44 devstack sudo[78925]: pam_unix(sudo:session): session closed for user root
Apr 13 17:01:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:01:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:01:44 devstack sudo[78935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:01:44 devstack sudo[78935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:01:44 devstack sudo[78935]: pam_unix(sudo:session): session closed for user root
Apr 13 17:01:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:01:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:01:44 devstack sudo[78941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:01:44 devstack sudo[78941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:01:45 devstack sudo[78941]: pam_unix(sudo:session): session closed for user root
Apr 13 17:01:45 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:01:45 devstack cinder-volume[73059]: DEBUG cinder.manager [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Notifying Schedulers of capabilities ... {{(pid=73059) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:02:41 devstack cinder-volume[73059]: DEBUG dbcounter [-] [73059] Writing DB stats cinder:SELECT=1 {{(pid=73059) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:02:41 devstack cinder-volume[73059]: DEBUG dbcounter [-] [73059] Writing DB stats cinder:UPDATE=1 {{(pid=73059) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:02:43 devstack cinder-volume[73059]: DEBUG oslo_service.periodic_task [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73059) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:02:43 devstack cinder-volume[73059]: DEBUG cinder.volume.drivers.lvm [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Updating volume stats {{(pid=73059) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 17:02:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:02:43 devstack sudo[80664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:02:43 devstack sudo[80664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:02:43 devstack sudo[80664]: pam_unix(sudo:session): session closed for user root
Apr 13 17:02:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:02:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:02:43 devstack sudo[80673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:02:43 devstack sudo[80673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:02:44 devstack sudo[80673]: pam_unix(sudo:session): session closed for user root
Apr 13 17:02:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:02:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:02:44 devstack sudo[80701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:02:44 devstack sudo[80701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:02:44 devstack sudo[80701]: pam_unix(sudo:session): session closed for user root
Apr 13 17:02:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:02:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:02:44 devstack sudo[80715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:02:44 devstack sudo[80715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:02:45 devstack sudo[80715]: pam_unix(sudo:session): session closed for user root
Apr 13 17:02:45 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:02:45 devstack cinder-volume[73059]: DEBUG cinder.manager [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Notifying Schedulers of capabilities ... {{(pid=73059) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:03:43 devstack cinder-volume[73059]: DEBUG oslo_service.periodic_task [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73059) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:03:43 devstack cinder-volume[73059]: DEBUG cinder.volume.drivers.lvm [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Updating volume stats {{(pid=73059) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 13 17:03:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:43 devstack sudo[81843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 13 17:03:43 devstack sudo[81843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:43 devstack sudo[81843]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:43 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:43 devstack sudo[81857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:03:43 devstack sudo[81857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:44 devstack sudo[81857]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:44 devstack sudo[81874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 13 17:03:44 devstack sudo[81874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:44 devstack sudo[81874]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.442s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:44 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:44 devstack sudo[81883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 13 17:03:44 devstack sudo[81883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:45 devstack sudo[81883]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:45 devstack cinder-volume[73059]: DEBUG oslo_concurrency.processutils [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=73059) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:45 devstack cinder-volume[73059]: DEBUG cinder.manager [None req-8dfbfc40-114a-4ea7-8408-333d957a1ca4 None None] Notifying Schedulers of capabilities ... {{(pid=73059) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:03:48 devstack cinder-volume[72955]: INFO oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Caught SIGTERM, stopping children
Apr 13 17:03:48 devstack cinder-volume[72955]: DEBUG oslo_concurrency.lockutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Acquiring lock "singleton_lock" {{(pid=72955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 17:03:48 devstack cinder-volume[72955]: DEBUG oslo_concurrency.lockutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Acquired lock "singleton_lock" {{(pid=72955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 17:03:48 devstack cinder-volume[72955]: DEBUG oslo_concurrency.lockutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Releasing lock "singleton_lock" {{(pid=72955) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 17:03:48 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Stop services. {{(pid=72955) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 17:03:48 devstack cinder-volume[72955]: DEBUG oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Killing children. {{(pid=72955) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 17:03:48 devstack cinder-volume[72955]: INFO oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Waiting on 1 children to exit
Apr 13 17:03:49 devstack cinder-volume[73059]: DEBUG oslo_concurrency.lockutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Acquiring lock "singleton_lock" {{(pid=73059) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 17:03:49 devstack cinder-volume[73059]: DEBUG oslo_concurrency.lockutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Acquired lock "singleton_lock" {{(pid=73059) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 17:03:49 devstack cinder-volume[73059]: DEBUG oslo_concurrency.lockutils [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Releasing lock "singleton_lock" {{(pid=73059) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 17:03:49 devstack cinder-volume[73059]: WARNING amqp [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 17:03:49 devstack cinder-volume[73059]: WARNING amqp [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 17:03:49 devstack cinder-volume[72955]: INFO oslo_service.backend._eventlet.service [None req-3d561cf6-2b5a-4be4-8d0d-55165ca46cb6 None None] Child 73059 exited with status 0
Apr 13 17:03:49 devstack cinder-volume[82119]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 17:03:49 devstack cinder-volume[82119]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 17:03:49 devstack cinder-volume[82119]: we strongly recommend against using it for new projects.
Apr 13 17:03:49 devstack cinder-volume[82119]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 17:03:49 devstack cinder-volume[82119]: framework.  For more detail see
Apr 13 17:03:49 devstack cinder-volume[82119]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 17:03:49 devstack cinder-volume[82119]:   import eventlet  # noqa
Apr 13 17:03:51 devstack cinder-volume[82119]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 17:03:51 devstack cinder-volume[82119]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 17:03:51 devstack cinder-volume[82119]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 17:03:52 devstack cinder-volume[82119]: INFO dbcounter [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Registered counter for database cinder
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_db.sqlalchemy.engines [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG dbcounter [-] [82119] Writer thread running {{(pid=82119) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 17:03:52 devstack cinder-volume[82119]: INFO cinder.rpc [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 17:03:52 devstack cinder-volume[82119]: INFO cinder.rpc [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_db.sqlalchemy.engines [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:03:52 devstack cinder-volume[82119]: INFO cinder.volume.manager [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Determined volume DB was empty at startup.
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG cinder.volume.manager [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82119) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 17:03:52 devstack cinder-volume[82119]: INFO cinder.volume.manager [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 13 17:03:52 devstack cinder-volume[82119]: WARNING stevedore.named [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 17:03:52 devstack cinder-volume[82119]: WARNING castellan.key_manager [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 17:03:52 devstack cinder-volume[82119]: WARNING cinder.keymgr.conf_key_mgr [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 17:03:52 devstack cinder-volume[82119]: INFO cinder.volume.manager [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_db.sqlalchemy.engines [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:03:52 devstack cinder-volume[82119]: INFO oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Starting 1 workers
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Started child 82240 {{(pid=82119) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Full set of CONF: {{(pid=82119) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] ******************************************************************************** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Configuration options gathered from: {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] ================================================================================ {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] allow_availability_zone_fallback = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] allow_compression_on_image_upload = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] allowed_direct_url_schemes     = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] api_rate_limit                 = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] auth_strategy                  = keystone {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_availability_zone      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_host                   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_name                   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_stats_polling_interval = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backup_api_class               = cinder.backup.api.API {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backup_name_template           = backup-%s {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backup_use_same_host           = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backup_use_temp_snapshot       = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82240]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] chap_password                  = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] chap_username                  =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_internal_tenant_project_id = f461f32c4add4f34a503091b11836f1c {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_internal_tenant_user_id = 16002f9dee864a57ae1685d0cbd9c59f {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cluster                        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] compression_format             = gzip {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] config_dir                     = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] config_source                  = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] control_exchange               = openstack {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] debug                          = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] default_availability_zone      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] default_group_type             = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] default_volume_type            = QuobyteHD {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] disk_geometry                  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] driver_client_cert             = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] driver_client_cert_key         = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] driver_data_namespace          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] driver_ssl_cert_path           = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] driver_ssl_cert_verify         = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] driver_use_ssl                 = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] enable_new_services            = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] enable_unsupported_driver      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] enforce_multipath_for_image_xfer = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] filter_function                = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_api_insecure            = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_api_servers             = ['http://192.168.122.196/image'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_api_ssl_compression     = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_ca_certificates_file    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_certfile                = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_keyfile                 = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_num_retries             = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance_request_timeout         = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] goodness_function              = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] graceful_shutdown_timeout      = 5 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] group_api_class                = cinder.group.api.API {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] host                           = devstack {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_compress_on_upload       = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_conversion_address_space_limit = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_conversion_cpu_limit     = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_conversion_disable       = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_upload_use_cinder_backend = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_upload_use_internal_tenant = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_volume_cache_enabled     = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_volume_cache_max_count   = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] image_volume_cache_max_size_gb = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] init_host_max_objects_retrieval = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] iscsi_target_flags             =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] iscsi_write_cache              = on {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] iser_helper                    = tgtadm {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] iser_ip_address                = 192.168.122.196 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] iser_port                      = 3260 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_color                      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_config_append              = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-02100b56-6aad-4518-8411-98bb761018af None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.remotefs [None req-02100b56-6aad-4518-8411-98bb761018af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82240) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_dir                        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_file                       = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_options                    = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_rotate_interval            = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_rotate_interval_type       = days {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] log_rotation_type              = none {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] max_age                        = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] max_logfile_count              = 30 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] max_logfile_size_mb            = 200 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] max_over_subscription_ratio    = 20.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] message_reap_interval          = 86400 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] message_ttl                    = 2592000 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] migration_create_volume_timeout_secs = 300 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] monkey_patch                   = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] monkey_patch_modules           = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] my_ip                          = 192.168.122.196 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] no_snapshot_gb_quota           = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] num_iser_scan_tries            = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] num_shell_tries                = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] num_volume_device_scan_tries   = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] nvmeof_conn_info_version       = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] nvmet_ns_id                    = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] nvmet_port_id                  = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] osapi_max_limit                = 1000 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] osapi_volume_ext_list          = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] osapi_volume_listen_port       = 8776 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] osapi_volume_use_ssl           = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] osapi_volume_workers           = 2 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] per_volume_size_limit          = -1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] periodic_fuzzy_delay           = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] periodic_interval              = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] public_endpoint                = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] publish_errors                 = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] quota_backup_gigabytes         = 1000 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] quota_backups                  = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] quota_gigabytes                = 1000 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] quota_groups                   = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] quota_snapshots                = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] quota_volumes                  = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] rate_limit_burst               = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] rate_limit_except_level        = CRITICAL {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] rate_limit_interval            = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] reinit_driver_count            = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] replication_device             = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] report_discard_supported       = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] report_interval                = 120 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] reservation_clean_interval     = 86400 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] reservation_expire             = 86400 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] reserved_image_namespaces      = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] reserved_percentage            = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] rpc_response_timeout           = 120 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] run_external_periodic_tasks    = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] scst_target_driver             = iscsi {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] scst_target_iqn_name           = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_down_time              = 720 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] shell_completion               = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] snapshot_name_template         = snapshot-%s {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] split_loggers                  = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] state_path                     = /opt/stack/data/cinder {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] storage_availability_zone      = nova {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] storage_protocol               = iSCSI {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] syslog_log_facility            = LOG_USER {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] target_helper                  = lioadm {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] target_ip_address              = 192.168.122.196 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] target_port                    = 3260 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] target_protocol                = iscsi {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] target_secondary_ip_addresses  = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] trace_flags                    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] transport_url                  = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] until_refresh                  = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] use_chap_auth                  = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] use_default_quota_class        = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] use_journal                    = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82240) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 17:03:52 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 17:03:52 devstack cinder-volume[82240]: WARNING cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] use_json                       = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] use_multipath_for_image_xfer   = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] use_stderr                     = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Running cmd (subprocess): mount.quobyte {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] use_syslog                     = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] verify_glance_signatures       = enabled {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_api_class               = cinder.volume.api.API {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_backend_name            = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_clear                   = zero {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_clear_ionice            = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_clear_size              = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_copy_bps_limit          = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_dd_blocksize            = 1M {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_name_template           = volume-%s {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_service_inithost_offload = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volume_usage_audit_period      = month {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] zoning_mode                    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_concurrency.disable_process_locking = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.admin_password = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.admin_token = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.admin_user  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_protocol = https {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_section = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_type   = password {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_uri    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.auth_version = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.cache       = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.certfile    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.identity_uri = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.include_service_catalog = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.insecure    = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.interface   = public {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.keyfile     = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_password =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcache_username =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.region_name = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.service_type = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.backend                  = dogpile.cache.null {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.backend_argument         = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.backend_expiration_time  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.config_prefix            = cache.oslo {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.debug_cache_backend      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.enable_retry_client      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.enable_socket_keepalive  = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.enabled                  = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.enforce_fips_mode        = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.expiration_time          = 600 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.hashclient_retry_attempts = 2 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.memcache_dead_retry      = 300 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.memcache_sasl_enabled    = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.password                 = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.proxies                  = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.redis_db                 = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.redis_server             = localhost:6379 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.retry_attempts           = 2 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.retry_delay              = 0.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.socket_keepalive_count   = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.socket_keepalive_idle    = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.socket_keepalive_interval = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.socket_timeout           = 1.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.tls_allowed_ciphers      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.tls_cafile               = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.tls_certfile             = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.tls_enabled              = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.tls_keyfile              = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cache.username                 = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] coordination.backend_url       = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.asyncio_connection    = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack quobyte-client[82242]: Reading configuration file: /etc/quobyte/client.cfg
Apr 13 17:03:52 devstack quobyte-client[82242]: Invalid parameters found, error: missing mount point.
Apr 13 17:03:52 devstack quobyte-client[82242]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 13 17:03:52 devstack quobyte-client[82242]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.asyncio_slave_connection = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.backend               = sqlalchemy {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.connection            = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.connection_debug      = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.connection_parameters =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.connection_recycle_time = 3600 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.connection_trace      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.db_inc_retry_interval = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.db_max_retries        = 20 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.db_max_retry_interval = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.db_retry_interval     = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.max_overflow          = 50 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.max_pool_size         = 5 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.max_retries           = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.mysql_wsrep_sync_wait = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.pool_timeout          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.retry_interval        = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.slave_connection      = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.sqlite_synchronous    = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.synchronous_reader    = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] database.use_db_reconnect      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.connection_string     = messaging:// {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.enabled               = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.es_doc_type           = notification {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82240]: INFO cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 ...
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.es_scroll_size        = 10000 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 -c /etc/quobyte/client-cinder.cfg {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.es_scroll_time        = 2m {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.filter_error_trace    = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.hmac_keys             = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.sentinel_service_name = mymaster {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.socket_timeout        = 0.1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.trace_requests        = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler.trace_sqlalchemy      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler_jaeger.process_tags   = {} {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler_jaeger.service_name_prefix = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] profiler_otlp.service_name_prefix = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.enforce_new_defaults = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: WARNING oslo_config.cfg [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.enforce_scope      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.policy_default_rule = default {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] privsep_osbrick.group          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] privsep_osbrick.helper_command = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] privsep_osbrick.user           = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack sudo[82245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 -c /etc/quobyte/client-cinder.cfg
Apr 13 17:03:52 devstack sudo[82245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_sys_admin.group         = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_sys_admin.helper_command = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] cinder_sys_admin.user          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.auth_section      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.auth_type         = password {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.cafile            = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.certfile          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.collect_timing    = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.insecure          = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.keyfile           = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.send_service_user_token = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.split_loggers     = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] service_user.timeout           = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.auth_section            = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.auth_type               = password {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.certfile                = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.collect_timing          = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.insecure                = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.keyfile                 = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.region_name             = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.split_loggers           = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] glance.timeout                 = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.backend_availability_zone = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.chap_password = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.chap_username =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.disk_geometry = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.driver_client_cert = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.driver_client_cert_key = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.driver_data_namespace = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.driver_use_ssl = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.extra_capabilities = {} {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.filter_function = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.goodness_function = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.iscsi_target_flags =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.iscsi_write_cache = on {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.iser_port     = 3260 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_host      =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_login     = admin {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_mount_options = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_password  = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_private_key =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_share_path =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.num_shell_tries = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.quobyte_volume_url = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.replication_device = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.report_discard_supported = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.reserved_percentage = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.target_helper = tgtadm {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.target_port   = 3260 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.target_protocol = iscsi {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.trace_flags   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.unique_fqdn_network = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.use_chap_auth = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_backend_name = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_clear  = zero {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_clear_ionice = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_clear_size = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_reports.file_event_handler = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_reports.log_dir           = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.backend_availability_zone = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.backend_host         = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.chap_password        = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.chap_username        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.disk_geometry        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.driver_client_cert   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.driver_data_namespace = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.extra_capabilities   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.filter_function      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.goodness_function    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.iser_helper          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.iser_ip_address      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.iser_port            = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_host             = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_login            = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_mount_options    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_password         = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_private_key      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_share_path       = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.num_shell_tries      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.replication_device   = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.report_discard_supported = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.reserved_percentage  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.scst_target_driver   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.storage_protocol     = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.target_helper        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.target_ip_address    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.target_port          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.target_prefix        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.target_protocol      = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.trace_flags          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.use_chap_auth        = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:52 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_clear         = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_clear_size    = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] QuobyteHD.volumes_dir          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_notifications.driver = [] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_notifications.retry = -1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] key_manager.fixed_key          = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.barbican_api_version  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.barbican_endpoint     = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.barbican_endpoint_type = public {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.barbican_region_name  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.cafile                = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.certfile              = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.collect_timing        = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.insecure              = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.keyfile               = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.number_of_retries     = 60 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.retry_delay           = 1 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.send_service_user_token = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.split_loggers         = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.timeout               = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.verify_ssl            = True {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican.verify_ssl_path       = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.auth_section = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.auth_type = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.cafile   = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.certfile = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.collect_timing = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.insecure = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.keyfile  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.split_loggers = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] barbican_service_user.timeout  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.approle_role_id          = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.approle_secret_id        = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.kv_mountpoint            = secret {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.kv_path                  = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.kv_version               = 2 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.namespace                = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.root_token_id            = **** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.ssl_ca_crt_file          = None {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.timeout                  = 60.0 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.use_ssl                  = False {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:03:53 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] ******************************************************************************** {{(pid=82119) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 17:03:53 devstack sudo[82245]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.606s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:53 devstack cinder-volume[82240]: INFO cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 succeeded
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.613s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:53 devstack sudo[82347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:03:53 devstack sudo[82347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:53 devstack sudo[82347]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.424s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:53 devstack cinder-volume[82240]: INFO cinder.volume.driver [None req-02100b56-6aad-4518-8411-98bb761018af None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG cinder.volume.driver [None req-02100b56-6aad-4518-8411-98bb761018af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6925888061523, 'free_capacity_gb': 1775.6925888061523, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82240) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG oslo_db.sqlalchemy.engines [None req-02100b56-6aad-4518-8411-98bb761018af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:03:53 devstack cinder-volume[82240]: DEBUG dbcounter [-] [82240] Writer thread running {{(pid=82240) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.db.sqlalchemy.api [None req-02100b56-6aad-4518-8411-98bb761018af None None] Building query based on filter {{(pid=82240) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.image.image_utils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82240) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 17:03:54 devstack cinder-volume[82240]: INFO cinder.keymgr.migration [None req-3d057ea3-8b80-4fd0-9894-4292b6ad6d1f None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:54 devstack sudo[82356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:03:54 devstack sudo[82356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:54 devstack sudo[82356]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.494s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.manager [None req-02100b56-6aad-4518-8411-98bb761018af None None] Notifying Schedulers of capabilities ... {{(pid=82240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:03:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-02100b56-6aad-4518-8411-98bb761018af None None] Driver initialization completed successfully.
Apr 13 17:03:54 devstack cinder-volume[82240]: INFO cinder.manager [None req-02100b56-6aad-4518-8411-98bb761018af None None] Initiating service 3 cleanup
Apr 13 17:03:54 devstack cinder-volume[82240]: INFO cinder.manager [None req-02100b56-6aad-4518-8411-98bb761018af None None] Service 3 cleanup completed.
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.service [None req-02100b56-6aad-4518-8411-98bb761018af None None] Creating RPC server for service cinder-volume {{(pid=82240) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.service [None req-02100b56-6aad-4518-8411-98bb761018af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82240) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 17:03:54 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-02100b56-6aad-4518-8411-98bb761018af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG cinder.volume.drivers.quobyte [None req-02100b56-6aad-4518-8411-98bb761018af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82240) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:03:54 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:03:54 devstack sudo[82381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:03:54 devstack sudo[82381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:03:55 devstack sudo[82381]: pam_unix(sudo:session): session closed for user root
Apr 13 17:03:55 devstack cinder-volume[82240]: DEBUG oslo_concurrency.processutils [None req-02100b56-6aad-4518-8411-98bb761018af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.520s {{(pid=82240) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:03:55 devstack cinder-volume[82240]: INFO cinder.volume.manager [None req-02100b56-6aad-4518-8411-98bb761018af None None] Driver post RPC initialization completed successfully.
Apr 13 17:03:56 devstack cinder-volume[82119]: INFO oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Caught SIGTERM, stopping children
Apr 13 17:03:56 devstack cinder-volume[82119]: DEBUG oslo_concurrency.lockutils [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Acquiring lock "singleton_lock" {{(pid=82119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 17:03:56 devstack cinder-volume[82119]: DEBUG oslo_concurrency.lockutils [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Acquired lock "singleton_lock" {{(pid=82119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 17:03:56 devstack cinder-volume[82119]: DEBUG oslo_concurrency.lockutils [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Releasing lock "singleton_lock" {{(pid=82119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 17:03:56 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Stop services. {{(pid=82119) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 13 17:03:56 devstack cinder-volume[82119]: DEBUG oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Killing children. {{(pid=82119) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 13 17:03:56 devstack cinder-volume[82119]: INFO oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Waiting on 1 children to exit
Apr 13 17:03:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Acquiring lock "singleton_lock" {{(pid=82240) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 17:03:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Acquired lock "singleton_lock" {{(pid=82240) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 17:03:58 devstack cinder-volume[82240]: DEBUG oslo_concurrency.lockutils [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Releasing lock "singleton_lock" {{(pid=82240) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 17:03:58 devstack cinder-volume[82240]: WARNING amqp [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 17:03:58 devstack cinder-volume[82240]: WARNING amqp [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 13 17:03:58 devstack cinder-volume[82119]: INFO oslo_service.backend._eventlet.service [None req-161f59db-e7b1-48ec-8005-ed05da6b2764 None None] Child 82240 exited with status 0
Apr 13 17:03:59 devstack cinder-volume[82499]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 13 17:03:59 devstack cinder-volume[82499]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 17:03:59 devstack cinder-volume[82499]: we strongly recommend against using it for new projects.
Apr 13 17:03:59 devstack cinder-volume[82499]: If you are already using Eventlet, we recommend migrating to a different
Apr 13 17:03:59 devstack cinder-volume[82499]: framework.  For more detail see
Apr 13 17:03:59 devstack cinder-volume[82499]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 17:03:59 devstack cinder-volume[82499]:   import eventlet  # noqa
Apr 13 17:04:00 devstack cinder-volume[82499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 13 17:04:00 devstack cinder-volume[82499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 13 17:04:00 devstack cinder-volume[82499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82499) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 13 17:04:01 devstack cinder-volume[82499]: INFO dbcounter [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Registered counter for database cinder
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_db.sqlalchemy.engines [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG dbcounter [-] [82499] Writer thread running {{(pid=82499) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 17:04:01 devstack cinder-volume[82499]: INFO cinder.rpc [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 13 17:04:01 devstack cinder-volume[82499]: INFO cinder.rpc [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_db.sqlalchemy.engines [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:04:01 devstack cinder-volume[82499]: INFO cinder.volume.manager [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Determined volume DB was empty at startup.
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG cinder.volume.manager [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82499) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 13 17:04:01 devstack cinder-volume[82499]: WARNING stevedore.named [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 13 17:04:01 devstack cinder-volume[82499]: WARNING castellan.key_manager [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 17:04:01 devstack cinder-volume[82499]: WARNING cinder.keymgr.conf_key_mgr [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 13 17:04:01 devstack cinder-volume[82499]: INFO cinder.volume.manager [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_db.sqlalchemy.engines [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:04:01 devstack cinder-volume[82499]: INFO oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Starting 1 workers
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Started child 82641 {{(pid=82499) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Full set of CONF: {{(pid=82499) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] ******************************************************************************** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Configuration options gathered from: {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] ================================================================================ {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] allow_availability_zone_fallback = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] allow_compression_on_image_upload = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] allowed_direct_url_schemes     = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] api_rate_limit                 = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] auth_strategy                  = keystone {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_availability_zone      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_host                   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_name                   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_stats_polling_interval = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backup_api_class               = cinder.backup.api.API {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82641]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backup_name_template           = backup-%s {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backup_use_same_host           = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backup_use_temp_snapshot       = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] chap_password                  = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] chap_username                  =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_internal_tenant_project_id = f461f32c4add4f34a503091b11836f1c {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_internal_tenant_user_id = 16002f9dee864a57ae1685d0cbd9c59f {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cluster                        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] compression_format             = gzip {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] config_dir                     = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] config_source                  = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] control_exchange               = openstack {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] debug                          = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] default_availability_zone      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] default_group_type             = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] default_volume_type            = QuobyteHD {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] disk_geometry                  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] driver_client_cert             = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] driver_client_cert_key         = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] driver_data_namespace          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] driver_ssl_cert_path           = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] driver_ssl_cert_verify         = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] driver_use_ssl                 = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] enable_new_services            = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] enable_unsupported_driver      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] enforce_multipath_for_image_xfer = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] filter_function                = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_api_insecure            = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_api_servers             = ['http://192.168.122.196/image'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_api_ssl_compression     = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_ca_certificates_file    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_certfile                = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_keyfile                 = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_num_retries             = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance_request_timeout         = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] goodness_function              = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] graceful_shutdown_timeout      = 5 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] group_api_class                = cinder.group.api.API {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] host                           = devstack {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_compress_on_upload       = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_conversion_address_space_limit = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_conversion_cpu_limit     = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_conversion_disable       = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_upload_use_cinder_backend = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_upload_use_internal_tenant = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_volume_cache_enabled     = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_volume_cache_max_count   = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] init_host_max_objects_retrieval = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] iscsi_target_flags             =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] iscsi_write_cache              = on {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] iser_helper                    = tgtadm {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] iser_ip_address                = 192.168.122.196 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] iser_port                      = 3260 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_color                      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_config_append              = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_dir                        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_file                       = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_options                    = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_rotate_interval            = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_rotate_interval_type       = days {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] log_rotation_type              = none {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] max_age                        = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] max_logfile_count              = 30 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] max_logfile_size_mb            = 200 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] max_over_subscription_ratio    = 20.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] message_reap_interval          = 86400 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] message_ttl                    = 2592000 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] monkey_patch                   = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] monkey_patch_modules           = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] my_ip                          = 192.168.122.196 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] no_snapshot_gb_quota           = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] num_iser_scan_tries            = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] num_shell_tries                = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] num_volume_device_scan_tries   = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] nvmeof_conn_info_version       = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] nvmet_ns_id                    = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] nvmet_port_id                  = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] osapi_max_limit                = 1000 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] osapi_volume_ext_list          = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] osapi_volume_listen_port       = 8776 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] osapi_volume_use_ssl           = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] osapi_volume_workers           = 2 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] per_volume_size_limit          = -1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] periodic_fuzzy_delay           = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] periodic_interval              = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] public_endpoint                = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] publish_errors                 = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] quota_backup_gigabytes         = 1000 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] quota_backups                  = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] quota_gigabytes                = 1000 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] quota_groups                   = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] quota_snapshots                = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 13 17:04:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82641) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] quota_volumes                  = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] rate_limit_burst               = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] rate_limit_except_level        = CRITICAL {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] rate_limit_interval            = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] reinit_driver_count            = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] replication_device             = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] report_discard_supported       = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] report_interval                = 120 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] reservation_clean_interval     = 86400 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] reservation_expire             = 86400 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] reserved_image_namespaces      = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] reserved_percentage            = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] rpc_response_timeout           = 120 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] run_external_periodic_tasks    = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] scst_target_driver             = iscsi {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] scst_target_iqn_name           = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_down_time              = 720 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] shell_completion               = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] snapshot_name_template         = snapshot-%s {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] split_loggers                  = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] state_path                     = /opt/stack/data/cinder {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] storage_availability_zone      = nova {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] storage_protocol               = iSCSI {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] syslog_log_facility            = LOG_USER {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] target_helper                  = lioadm {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] target_ip_address              = 192.168.122.196 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] target_port                    = 3260 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] target_protocol                = iscsi {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] target_secondary_ip_addresses  = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] trace_flags                    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] transport_url                  = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] until_refresh                  = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] use_chap_auth                  = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] use_default_quota_class        = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] use_journal                    = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] use_json                       = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] use_multipath_for_image_xfer   = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] use_stderr                     = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] use_syslog                     = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] verify_glance_signatures       = enabled {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_api_class               = cinder.volume.api.API {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_backend_name            = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_clear                   = zero {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_clear_ionice            = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_clear_size              = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_copy_bps_limit          = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_dd_blocksize            = 1M {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_name_template           = volume-%s {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_service_inithost_offload = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volume_usage_audit_period      = month {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] zoning_mode                    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.admin_password = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.admin_token = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.admin_user  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_protocol = https {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_section = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_type   = password {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_uri    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.auth_version = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.cache       = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.certfile    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.identity_uri = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.insecure    = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.interface   = public {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.keyfile     = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_password =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcache_username =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.region_name = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.service_type = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.backend                  = dogpile.cache.null {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.backend_argument         = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.backend_expiration_time  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.config_prefix            = cache.oslo {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.debug_cache_backend      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.enable_retry_client      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.enable_socket_keepalive  = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.enabled                  = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.enforce_fips_mode        = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.expiration_time          = 600 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.memcache_dead_retry      = 300 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.memcache_sasl_enabled    = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.password                 = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.proxies                  = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.redis_db                 = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.redis_server             = localhost:6379 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.retry_attempts           = 2 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.retry_delay              = 0.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.socket_keepalive_count   = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.socket_keepalive_idle    = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.socket_keepalive_interval = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.socket_timeout           = 1.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.tls_allowed_ciphers      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.tls_cafile               = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.tls_certfile             = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.tls_enabled              = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.tls_keyfile              = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cache.username                 = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] coordination.backend_url       = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.asyncio_connection    = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.asyncio_slave_connection = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.backend               = sqlalchemy {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.connection            = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.connection_debug      = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.connection_parameters =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.connection_recycle_time = 3600 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.connection_trace      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.db_inc_retry_interval = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.db_max_retries        = 20 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.db_max_retry_interval = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.db_retry_interval     = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.max_overflow          = 50 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.max_pool_size         = 5 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.max_retries           = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.pool_timeout          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.retry_interval        = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.slave_connection      = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.sqlite_synchronous    = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.synchronous_reader    = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] database.use_db_reconnect      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.connection_string     = messaging:// {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.enabled               = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.es_doc_type           = notification {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.es_scroll_size        = 10000 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.es_scroll_time        = 2m {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.filter_error_trace    = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.hmac_keys             = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.sentinel_service_name = mymaster {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.socket_timeout        = 0.1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.trace_requests        = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler.trace_sqlalchemy      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler_jaeger.process_tags   = {} {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] profiler_otlp.service_name_prefix = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.enforce_new_defaults = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: WARNING oslo_config.cfg [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.enforce_scope      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.policy_default_rule = default {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] privsep_osbrick.group          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] privsep_osbrick.helper_command = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] privsep_osbrick.user           = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_sys_admin.group         = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_sys_admin.helper_command = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82641) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 13 17:04:01 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 13 17:04:01 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] cinder_sys_admin.user          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.auth_section      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.auth_type         = password {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.cafile            = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Running cmd (subprocess): mount.quobyte {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.certfile          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.collect_timing    = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.insecure          = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.keyfile           = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.send_service_user_token = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.split_loggers     = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] service_user.timeout           = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.auth_section            = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.auth_type               = password {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.certfile                = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.collect_timing          = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.insecure                = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.keyfile                 = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.region_name             = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.split_loggers           = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] glance.timeout                 = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.backend_availability_zone = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.chap_password = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.chap_username =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.disk_geometry = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.driver_client_cert = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.driver_data_namespace = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.driver_use_ssl = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.extra_capabilities = {} {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.filter_function = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.goodness_function = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.iscsi_target_flags =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.iser_port     = 3260 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_host      =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_login     = admin {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_mount_options = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_password  = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_private_key =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_share_path =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.quobyte_volume_url = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.replication_device = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.report_discard_supported = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.target_helper = tgtadm {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.target_port   = 3260 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.target_protocol = iscsi {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.trace_flags   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.use_chap_auth = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_backend_name = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_clear  = zero {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_reports.file_event_handler = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_reports.log_dir           = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.backend_availability_zone = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.backend_host         = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.chap_password        = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.chap_username        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.disk_geometry        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.driver_client_cert   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.driver_data_namespace = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.extra_capabilities   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.filter_function      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.goodness_function    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:01 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.iser_helper          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.iser_ip_address      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.iser_port            = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_host             = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_login            = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_mount_options    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_password         = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_private_key      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_share_path       = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.num_shell_tries      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.replication_device   = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.report_discard_supported = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.reserved_percentage  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.scst_target_driver   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.storage_protocol     = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.target_helper        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.target_ip_address    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.target_port          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.target_prefix        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] CMD "mount.quobyte" returned: 1 in 0.203s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.target_protocol      = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.trace_flags          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.use_chap_auth        = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_clear         = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_clear_size    = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] QuobyteHD.volumes_dir          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_notifications.driver = [] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] key_manager.fixed_key          = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.barbican_api_version  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.barbican_endpoint     = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.barbican_endpoint_type = public {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.barbican_region_name  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.cafile                = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.certfile              = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.collect_timing        = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.insecure              = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.keyfile               = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.number_of_retries     = 60 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.retry_delay           = 1 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.send_service_user_token = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.split_loggers         = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.timeout               = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.verify_ssl            = True {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican.verify_ssl_path       = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.auth_section = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.auth_type = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.cafile   = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.certfile = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.collect_timing = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.insecure = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.keyfile  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.split_loggers = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] barbican_service_user.timeout  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.approle_role_id          = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.approle_secret_id        = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.kv_mountpoint            = secret {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.kv_path                  = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.kv_version               = 2 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.namespace                = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.root_token_id            = **** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.ssl_ca_crt_file          = None {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.timeout                  = 60.0 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.use_ssl                  = False {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 13 17:04:02 devstack cinder-volume[82499]: DEBUG oslo_service.backend._eventlet.service [None req-c1693e17-f95c-4242-9002-9e9ac41678c1 None None] ******************************************************************************** {{(pid=82499) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 13 17:04:02 devstack sudo[82706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:04:02 devstack sudo[82706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:04:02 devstack sudo[82706]: pam_unix(sudo:session): session closed for user root
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:04:02 devstack cinder-volume[82641]: INFO cinder.volume.driver [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Driver hasn't implemented _init_vendor_properties()
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.volume.driver [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.691879272461, 'free_capacity_gb': 1775.691879272461, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82641) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_db.sqlalchemy.engines [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82641) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writer thread running {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.db.sqlalchemy.api [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Building query based on filter {{(pid=82641) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82641) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:04:02 devstack cinder-volume[82641]: INFO cinder.keymgr.migration [None req-1696dff6-e850-4143-a180-9bd9599d43e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 13 17:04:02 devstack sudo[82726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:04:02 devstack sudo[82726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:04:02 devstack sudo[82726]: pam_unix(sudo:session): session closed for user root
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:04:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Driver initialization completed successfully.
Apr 13 17:04:02 devstack cinder-volume[82641]: INFO cinder.manager [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Initiating service 3 cleanup
Apr 13 17:04:02 devstack cinder-volume[82641]: INFO cinder.manager [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Service 3 cleanup completed.
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.service [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Creating RPC server for service cinder-volume {{(pid=82641) start /opt/stack/cinder/cinder/service.py:231}}
Apr 13 17:04:02 devstack cinder-volume[82641]: DEBUG cinder.service [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82641) start /opt/stack/cinder/cinder/service.py:237}}
Apr 13 17:04:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 13 17:04:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:04:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:04:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:04:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:04:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:04:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:04:03 devstack sudo[82742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:04:03 devstack sudo[82742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:04:03 devstack sudo[82742]: pam_unix(sudo:session): session closed for user root
Apr 13 17:04:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:04:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d68ff64d-5246-4032-a7e0-895ee6ffb6ee None None] Driver post RPC initialization completed successfully.
Apr 13 17:04:11 devstack cinder-volume[82499]: DEBUG dbcounter [-] [82499] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82499) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:04:12 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=3 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:04:13 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Flow 'volume_create_manager' (882ee7ee-7a3b-4bc6-8123-8907696b9247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a63bd3-1122-4c2f-a007-4b9b32d9beef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a63bd3-1122-4c2f-a007-4b9b32d9beef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-504349359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc7fa75-7236-45a1-a787-def42dfd2e3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81e079a18d1b4c4caa0cb90840f67914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:01Z,use_quota=True,user_id='68613f9dad084f8cad872049eed7beb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871d3514-595e-4456-8c99-cb7c35153827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (871d3514-595e-4456-8c99-cb7c35153827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a01a1b-148f-4ea8-bf11-a642e070ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a01a1b-148f-4ea8-bf11-a642e070ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc7fa75-7236-45a1-a787-def42dfd2e3e', 'volume_name': 'volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702c64d3-8efe-4fef-bd45-77b8a8e0ca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702c64d3-8efe-4fef-bd45-77b8a8e0ca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5793df00-5435-4ec6-9056-721bc5876fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Volume 4fc7fa75-7236-45a1-a787-def42dfd2e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e', 'volume_size': 1}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-504349359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc7fa75-7236-45a1-a787-def42dfd2e3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='81e079a18d1b4c4caa0cb90840f67914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:01Z,use_quota=True,user_id='68613f9dad084f8cad872049eed7beb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Creating volume 4fc7fa75-7236-45a1-a787-def42dfd2e3e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:01 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:01 devstack sudo[83155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e 1073741824
Apr 13 17:05:01 devstack sudo[83155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Flow 'volume_create_manager' (0022c0fe-f91f-4b21-a632-211b6bafe386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197a5a27-a835-4b69-996e-2bd708cbd05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (197a5a27-a835-4b69-996e-2bd708cbd05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-102390906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed93b25b-8092-4d3b-9017-8a991b8a3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48af47975964ee5b279d2d0f3a0526c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:01Z,use_quota=True,user_id='5d42f037870047cf99503b71701bff1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63660597-951f-438e-9ac1-aac7322de6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63660597-951f-438e-9ac1-aac7322de6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5293df51-e4ce-4e7e-876c-35c51f1d9732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5293df51-e4ce-4e7e-876c-35c51f1d9732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed93b25b-8092-4d3b-9017-8a991b8a3fd6', 'volume_name': 'volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0479d6af-e71a-4a03-b7a3-7c45a95ebb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0479d6af-e71a-4a03-b7a3-7c45a95ebb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f1c4c1-512c-4dc5-9fea-608d36269841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Volume ed93b25b-8092-4d3b-9017-8a991b8a3fd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6', 'volume_size': 1}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Flow 'volume_create_manager' (b16d56a5-2c27-4c41-82a1-9cbbfd5ca4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ae7988-5bb5-47aa-8540-033d18c0205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ae7988-5bb5-47aa-8540-033d18c0205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-993777393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b5368a-3381-4524-a6ea-3783c29d1eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6d75b41ef24e32ba295a2e47e9ca21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:01Z,use_quota=True,user_id='557e04f3ab624bd6a1cf23fe5716ead5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2e7eed-bcd4-40ec-b1b3-6df6208adb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2e7eed-bcd4-40ec-b1b3-6df6208adb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dc62bf-4d6d-476f-9abf-23d0dd3e7035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dc62bf-4d6d-476f-9abf-23d0dd3e7035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b5368a-3381-4524-a6ea-3783c29d1eec', 'volume_name': 'volume-c7b5368a-3381-4524-a6ea-3783c29d1eec', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774fe2ec-4698-416f-884f-64c3bd796469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774fe2ec-4698-416f-884f-64c3bd796469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb46e59-0283-483c-bb77-4d8f2bd5b754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Volume c7b5368a-3381-4524-a6ea-3783c29d1eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b5368a-3381-4524-a6ea-3783c29d1eec', 'volume_size': 1}
Apr 13 17:05:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:02 devstack sudo[83155]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e 1073741824" returned: 0 in 1.042s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:02 devstack sudo[83484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e
Apr 13 17:05:02 devstack sudo[83484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:03 devstack sudo[83484]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e" returned: 0 in 0.736s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-102390906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed93b25b-8092-4d3b-9017-8a991b8a3fd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48af47975964ee5b279d2d0f3a0526c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:01Z,use_quota=True,user_id='5d42f037870047cf99503b71701bff1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Creating volume ed93b25b-8092-4d3b-9017-8a991b8a3fd6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:03 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5793df00-5435-4ec6-9056-721bc5876fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e05868b-5760-486d-a0c4-dc9bb42400c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:03 devstack sudo[83490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 1073741824
Apr 13 17:05:03 devstack sudo[83490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Volume volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e (4fc7fa75-7236-45a1-a787-def42dfd2e3e): created successfully
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e05868b-5760-486d-a0c4-dc9bb42400c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Flow 'volume_create_manager' (882ee7ee-7a3b-4bc6-8123-8907696b9247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-a7bc3de4-e47a-4fa9-b315-49c0442c74c2 req-2a9414c0-a11a-4fc4-acff-241d396ff061 tempest-VolumesGetTestJSON-827593556 None] Created volume successfully.
Apr 13 17:05:04 devstack sudo[83490]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 1073741824" returned: 0 in 1.272s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:04 devstack sudo[83497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6
Apr 13 17:05:04 devstack sudo[83497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Acquiring lock "cinder-4fc7fa75-7236-45a1-a787-def42dfd2e3e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Lock "cinder-4fc7fa75-7236-45a1-a787-def42dfd2e3e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Acquiring lock "cinder-quobyte-4fc7fa75-7236-45a1-a787-def42dfd2e3e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Lock "cinder-quobyte-4fc7fa75-7236-45a1-a787-def42dfd2e3e" acquired by "delete_volume" :: waited 0.029s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:05 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp70_g97se/privsep.sock']
Apr 13 17:05:05 devstack sudo[83499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp70_g97se/privsep.sock
Apr 13 17:05:05 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 17:05:05 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 13 17:05:06 devstack sudo[83497]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6" returned: 0 in 1.860s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] <== create_volume: return (3209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.212s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.629s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-993777393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b5368a-3381-4524-a6ea-3783c29d1eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f6d75b41ef24e32ba295a2e47e9ca21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:01Z,use_quota=True,user_id='557e04f3ab624bd6a1cf23fe5716ead5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Creating volume c7b5368a-3381-4524-a6ea-3783c29d1eec {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:06 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34f1c4c1-512c-4dc5-9fea-608d36269841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:06 devstack sudo[83503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec 1073741824
Apr 13 17:05:06 devstack sudo[83503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0e1065-a778-41ea-81df-95c0ee0ca0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:06 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Volume volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 (ed93b25b-8092-4d3b-9017-8a991b8a3fd6): created successfully
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0e1065-a778-41ea-81df-95c0ee0ca0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Flow 'volume_create_manager' (0022c0fe-f91f-4b21-a632-211b6bafe386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-37480023-2fb7-4b69-8ac1-c7ee6d4d85d6 tempest-DeleteServersTestJSON-1192795968 None] Created volume successfully.
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 13 17:05:06 devstack cinder-volume[82641]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 13 17:05:07 devstack sudo[83503]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:07 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec 1073741824" returned: 0 in 0.974s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:07 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Spawned new privsep daemon via rootwrap
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Accepted privsep connection to /tmp/tmp70_g97se/privsep.sock {{(pid=82641) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 13 17:05:07 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 17:05:07 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 17:05:07 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 17:05:07 devstack cinder-volume[82641]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83513
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6eb37c-3229-4b3c-bc6c-a1e232751d41]: (2,) {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db3f98d-d4ea-456d-b756-7214661a101c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:07 devstack sudo[83518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec
Apr 13 17:05:07 devstack sudo[83518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:07 devstack sudo[83519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e
Apr 13 17:05:07 devstack sudo[83519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:07 devstack sudo[83519]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:08 devstack sudo[83526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e
Apr 13 17:05:08 devstack sudo[83526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:08 devstack sudo[83518]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec" returned: 0 in 0.781s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb46e59-0283-483c-bb77-4d8f2bd5b754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b5368a-3381-4524-a6ea-3783c29d1eec', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8701c2ea-cbed-4625-aa06-a2c5049d027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Volume volume-c7b5368a-3381-4524-a6ea-3783c29d1eec (c7b5368a-3381-4524-a6ea-3783c29d1eec): created successfully
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8701c2ea-cbed-4625-aa06-a2c5049d027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Flow 'volume_create_manager' (b16d56a5-2c27-4c41-82a1-9cbbfd5ca4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ec0e3fed-5056-487b-8f40-32de23245406 tempest-VolumesAdminNegativeTest-1838334103 None] Created volume successfully.
Apr 13 17:05:08 devstack sudo[83526]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4fc7fa75-7236-45a1-a787-def42dfd2e3e" returned: 0 in 0.685s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Lock "cinder-quobyte-4fc7fa75-7236-45a1-a787-def42dfd2e3e" released by "delete_volume" :: held 3.573s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:08 devstack cinder-volume[82641]: WARNING cinder.quota [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:05:08 devstack cinder-volume[82641]: WARNING cinder.quota [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.quota [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Created reservations ['429d3c01-c28c-4537-b5ea-3915d46d3ef9', '883c5d1b-37b7-4ce1-8c78-d510111d37ef', 'af546280-b4cd-4dcb-a1ea-ef4ce56cfc78', '77ad861b-a60a-405e-be03-71cd8e0b2c6d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:08 devstack sudo[83539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:08 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:09 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.588s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:09 devstack cinder-volume[82641]: DEBUG cinder.manager [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Deleted volume successfully.
Apr 13 17:05:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-e2e0803a-4afa-4902-a996-909bfdf9b614 req-ce3614b8-49f3-40b0-8531-73dc91aab552 tempest-VolumesGetTestJSON-827593556 None] Lock "cinder-4fc7fa75-7236-45a1-a787-def42dfd2e3e-delete_volume" released by "delete_volume" :: held 4.507s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Acquiring lock "cinder-c7b5368a-3381-4524-a6ea-3783c29d1eec-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Lock "cinder-c7b5368a-3381-4524-a6ea-3783c29d1eec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Acquiring lock "cinder-quobyte-c7b5368a-3381-4524-a6ea-3783c29d1eec" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Lock "cinder-quobyte-c7b5368a-3381-4524-a6ea-3783c29d1eec" acquired by "delete_volume" :: waited 0.026s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5802395e-98f0-4507-acf9-cee032f0ac50]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:10 devstack sudo[83546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec
Apr 13 17:05:10 devstack sudo[83546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:11 devstack sudo[83546]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec" returned: 0 in 0.874s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:11 devstack sudo[83555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec
Apr 13 17:05:11 devstack sudo[83555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:11 devstack sudo[83555]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7b5368a-3381-4524-a6ea-3783c29d1eec" returned: 0 in 0.653s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Lock "cinder-quobyte-c7b5368a-3381-4524-a6ea-3783c29d1eec" released by "delete_volume" :: held 1.551s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Created reservations ['4368877e-fa78-437c-9d6b-07cc588dc05c', '3c7498de-ccd5-48f9-9b2e-6238dac31ee1', 'fbf24478-f46d-45a0-b58a-a28704dd7d18', 'f52b88b7-97b7-420d-9681-d64e1338a228'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:11 devstack sudo[83559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:11 devstack sudo[83559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:12 devstack sudo[83565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:12 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:12 devstack sudo[83559]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.898s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Deleted volume successfully.
Apr 13 17:05:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-623d521d-1d35-426f-a48c-cdd2489c576c tempest-VolumesAdminNegativeTest-1838334103 None] Lock "cinder-c7b5368a-3381-4524-a6ea-3783c29d1eec-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:13 devstack cinder-volume[82641]: WARNING py.warnings [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 13 17:05:13 devstack cinder-volume[82641]:   .first()
Apr 13 17:05:13 devstack cinder-volume[82641]: 
Apr 13 17:05:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[12900e21-17ce-42ac-862d-d88928ee9069]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:13 devstack sudo[83578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6
Apr 13 17:05:13 devstack sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:13 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.198s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:14 devstack sudo[83578]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6" returned: 0 in 0.744s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5', 'name': 'volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77e2cdef-4cfe-4f6d-b3d7-b34c41488b61', 'enforce_multipath': True} {{(pid=82641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 17:05:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-6075c30f-db3b-4a9e-a363-5654cb743c85 req-0225b9b6-e585-466f-9b98-ef17ce29defb tempest-DeleteServersTestJSON-1192795968 None] attachment_update completed successfully.
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Flow 'volume_create_manager' (076cfa5d-6073-4c69-b921-0dbde79ae905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3f0246-834a-4d5f-9134-559cae9b7d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3f0246-834a-4d5f-9134-559cae9b7d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1974303462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbb36c1-7010-4d4e-9307-728490199310,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d707f481a4a8a92f27923dc127f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:14Z,use_quota=True,user_id='bbb6b2270ed9463c83bf2ee4c24a0cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e56284-e250-4760-9299-b2f65f00defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e56284-e250-4760-9299-b2f65f00defc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5461270-cda6-4723-923e-c3db632b1df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5461270-cda6-4723-923e-c3db632b1df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccbb36c1-7010-4d4e-9307-728490199310', 'volume_name': 'volume-ccbb36c1-7010-4d4e-9307-728490199310', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a941b9-8781-4e1a-bf59-4053a66a8806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a941b9-8781-4e1a-bf59-4053a66a8806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07e3f25-5a30-4f64-b4fe-8c8c18128877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Volume ccbb36c1-7010-4d4e-9307-728490199310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccbb36c1-7010-4d4e-9307-728490199310', 'volume_size': 1}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1974303462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbb36c1-7010-4d4e-9307-728490199310,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d707f481a4a8a92f27923dc127f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:14Z,use_quota=True,user_id='bbb6b2270ed9463c83bf2ee4c24a0cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Creating volume ccbb36c1-7010-4d4e-9307-728490199310 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:14 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:14 devstack sudo[83616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310 1073741824
Apr 13 17:05:14 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:15 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310 1073741824" returned: 0 in 0.725s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:15 devstack sudo[83706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310
Apr 13 17:05:15 devstack sudo[83706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:15 devstack sudo[83706]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07e3f25-5a30-4f64-b4fe-8c8c18128877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccbb36c1-7010-4d4e-9307-728490199310', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06189b8-9d97-4bb6-b054-184ad5cc0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Volume volume-ccbb36c1-7010-4d4e-9307-728490199310 (ccbb36c1-7010-4d4e-9307-728490199310): created successfully
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06189b8-9d97-4bb6-b054-184ad5cc0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Flow 'volume_create_manager' (076cfa5d-6073-4c69-b921-0dbde79ae905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e46fd89c-81f4-4494-ac8d-64486be98a02 tempest-VolumesTestJSON-196725901 None] Created volume successfully.
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Flow 'volume_create_manager' (c0485cdc-1e90-4451-9ff2-3c37232fffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67c602e-5eb4-4c4c-99da-72b21f59a396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67c602e-5eb4-4c4c-99da-72b21f59a396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1478339944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bbf8d7-ed36-4606-9b58-e85c50148fec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d707f481a4a8a92f27923dc127f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:17Z,use_quota=True,user_id='bbb6b2270ed9463c83bf2ee4c24a0cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6d0978-fc87-4847-91e5-9b2f4fc2f4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd6d0978-fc87-4847-91e5-9b2f4fc2f4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ff3e30-b86a-4c25-a3b1-41a2062454e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ff3e30-b86a-4c25-a3b1-41a2062454e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88bbf8d7-ed36-4606-9b58-e85c50148fec', 'volume_name': 'volume-88bbf8d7-ed36-4606-9b58-e85c50148fec', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5c70cc-e597-417a-9853-db3c415664bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5c70cc-e597-417a-9853-db3c415664bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03ee883-81ce-4ea5-9b41-7d51bd24cee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Volume 88bbf8d7-ed36-4606-9b58-e85c50148fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88bbf8d7-ed36-4606-9b58-e85c50148fec', 'volume_size': 1}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1478339944',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bbf8d7-ed36-4606-9b58-e85c50148fec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d707f481a4a8a92f27923dc127f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:17Z,use_quota=True,user_id='bbb6b2270ed9463c83bf2ee4c24a0cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Creating volume 88bbf8d7-ed36-4606-9b58-e85c50148fec {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:16 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:16 devstack sudo[84028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec 1073741824
Apr 13 17:05:16 devstack sudo[84028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:17 devstack sudo[84028]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec 1073741824" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:17 devstack sudo[84034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec
Apr 13 17:05:17 devstack sudo[84034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:17 devstack sudo[84034]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec" returned: 0 in 0.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03ee883-81ce-4ea5-9b41-7d51bd24cee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88bbf8d7-ed36-4606-9b58-e85c50148fec', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a118110-6568-4397-9def-7c23e4e3e3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Volume volume-88bbf8d7-ed36-4606-9b58-e85c50148fec (88bbf8d7-ed36-4606-9b58-e85c50148fec): created successfully
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a118110-6568-4397-9def-7c23e4e3e3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Flow 'volume_create_manager' (c0485cdc-1e90-4451-9ff2-3c37232fffe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0d793d73-15e7-4dd4-87e2-105b391b2bbb tempest-VolumesTestJSON-196725901 None] Created volume successfully.
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Flow 'volume_create_manager' (6d82ea84-3894-4721-9ada-6f2055752d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a000fa-55e0-41c5-a48d-20e01aea1ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a000fa-55e0-41c5-a48d-20e01aea1ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2122206451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3e6851-c41a-45cc-8da1-dbed25b01b9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d707f481a4a8a92f27923dc127f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:19Z,use_quota=True,user_id='bbb6b2270ed9463c83bf2ee4c24a0cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97472647-2a55-46d9-a2d2-a02285657fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97472647-2a55-46d9-a2d2-a02285657fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f21e965-5cfc-47dc-aa78-c2ed2686a0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f21e965-5cfc-47dc-aa78-c2ed2686a0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3e6851-c41a-45cc-8da1-dbed25b01b9d', 'volume_name': 'volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2168af65-c95f-42e5-8d81-9c0b4304a88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2168af65-c95f-42e5-8d81-9c0b4304a88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcbeb13-3a4f-4a4a-82a1-06f535429511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:19 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Volume fa3e6851-c41a-45cc-8da1-dbed25b01b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d', 'volume_size': 1}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2122206451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3e6851-c41a-45cc-8da1-dbed25b01b9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e9d707f481a4a8a92f27923dc127f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:19Z,use_quota=True,user_id='bbb6b2270ed9463c83bf2ee4c24a0cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Creating volume fa3e6851-c41a-45cc-8da1-dbed25b01b9d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:19 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:19 devstack sudo[84042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d 1073741824
Apr 13 17:05:19 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:20 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d 1073741824" returned: 0 in 0.701s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:20 devstack sudo[84080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d
Apr 13 17:05:20 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:20 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d" returned: 0 in 0.672s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcbeb13-3a4f-4a4a-82a1-06f535429511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088d2873-7dff-443d-b87f-853527f44510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:20 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Volume volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d (fa3e6851-c41a-45cc-8da1-dbed25b01b9d): created successfully
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088d2873-7dff-443d-b87f-853527f44510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Flow 'volume_create_manager' (6d82ea84-3894-4721-9ada-6f2055752d61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fb4ff946-d555-49ba-bd80-e69cbac2a54b tempest-VolumesTestJSON-196725901 None] Created volume successfully.
Apr 13 17:05:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Acquiring lock "cinder-fa3e6851-c41a-45cc-8da1-dbed25b01b9d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Lock "cinder-fa3e6851-c41a-45cc-8da1-dbed25b01b9d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Acquiring lock "cinder-quobyte-fa3e6851-c41a-45cc-8da1-dbed25b01b9d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Lock "cinder-quobyte-fa3e6851-c41a-45cc-8da1-dbed25b01b9d" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e671d-1adf-4bbc-81bd-ef1bd0f03ad5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:22 devstack sudo[84138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d
Apr 13 17:05:22 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-bd7e09ad-cdc0-451c-8e40-58334b6c9a16 req-cc32158b-13df-4895-83e0-6138ddd027a7 tempest-DeleteServersTestJSON-1192795968 None] Terminate volume connection completed successfully.
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bd7e09ad-cdc0-451c-8e40-58334b6c9a16 req-cc32158b-13df-4895-83e0-6138ddd027a7 tempest-DeleteServersTestJSON-1192795968 None] Deleting attachment 77e2cdef-4cfe-4f6d-b3d7-b34c41488b61. {{(pid=82641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 17:05:23 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d" returned: 0 in 0.586s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:23 devstack sudo[84147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d
Apr 13 17:05:23 devstack sudo[84147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:23 devstack sudo[84147]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fa3e6851-c41a-45cc-8da1-dbed25b01b9d" returned: 0 in 0.776s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Lock "cinder-quobyte-fa3e6851-c41a-45cc-8da1-dbed25b01b9d" released by "delete_volume" :: held 1.407s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Created reservations ['07b43282-07a7-4a8e-8c8a-cb84b0ad619d', '8c09397f-8c33-4c81-ae4a-ceb298707056', '376d13cc-e125-43b3-b04a-ecaf509ffb42', '1a9c238c-c33f-40c3-91c9-fa9a8719855c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:24 devstack sudo[84154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:24 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:24 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Deleted volume successfully.
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-62ce039d-e39f-450b-9655-335047ec9266 tempest-VolumesTestJSON-196725901 None] Lock "cinder-fa3e6851-c41a-45cc-8da1-dbed25b01b9d-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Acquiring lock "cinder-88bbf8d7-ed36-4606-9b58-e85c50148fec-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Lock "cinder-88bbf8d7-ed36-4606-9b58-e85c50148fec-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Acquiring lock "cinder-quobyte-88bbf8d7-ed36-4606-9b58-e85c50148fec" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Lock "cinder-quobyte-88bbf8d7-ed36-4606-9b58-e85c50148fec" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb53bc7-4934-4313-973a-e8c990ec045e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:24 devstack sudo[84158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec
Apr 13 17:05:24 devstack sudo[84158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:25 devstack sudo[84158]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec" returned: 0 in 0.580s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:25 devstack sudo[84163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec
Apr 13 17:05:25 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:25 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88bbf8d7-ed36-4606-9b58-e85c50148fec" returned: 0 in 0.605s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Lock "cinder-quobyte-88bbf8d7-ed36-4606-9b58-e85c50148fec" released by "delete_volume" :: held 1.216s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Created reservations ['7fb04692-a7ed-41c4-956a-b4f2906ca96b', 'ade3dd26-c120-4b89-a5d1-8df907366da2', '939fad24-ae32-4adf-bdd7-fc1bb33e8268', '5bf830c3-b50f-4160-a8d9-72b265954480'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:26 devstack sudo[84167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:26 devstack sudo[84167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:26 devstack sudo[84167]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.600s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Deleted volume successfully.
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df93af14-4e68-4a83-b15b-4379d4f32eb5 tempest-VolumesTestJSON-196725901 None] Lock "cinder-88bbf8d7-ed36-4606-9b58-e85c50148fec-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Acquiring lock "cinder-ccbb36c1-7010-4d4e-9307-728490199310-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Lock "cinder-ccbb36c1-7010-4d4e-9307-728490199310-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Acquiring lock "cinder-quobyte-ccbb36c1-7010-4d4e-9307-728490199310" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Lock "cinder-quobyte-ccbb36c1-7010-4d4e-9307-728490199310" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[11581943-e506-4842-ab87-3957aad467b3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Acquiring lock "cinder-ed93b25b-8092-4d3b-9017-8a991b8a3fd6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Lock "cinder-ed93b25b-8092-4d3b-9017-8a991b8a3fd6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Acquiring lock "cinder-quobyte-ed93b25b-8092-4d3b-9017-8a991b8a3fd6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Lock "cinder-quobyte-ed93b25b-8092-4d3b-9017-8a991b8a3fd6" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f5eb90-96a2-41b0-a7b2-fa38a1346da0]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:27 devstack sudo[84170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310
Apr 13 17:05:27 devstack sudo[84170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:27 devstack sudo[84172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6
Apr 13 17:05:27 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:27 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6" returned: 0 in 0.593s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:27 devstack sudo[84181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6
Apr 13 17:05:27 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:27 devstack sudo[84170]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310" returned: 0 in 0.795s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:27 devstack sudo[84183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310
Apr 13 17:05:27 devstack sudo[84183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:28 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed93b25b-8092-4d3b-9017-8a991b8a3fd6" returned: 0 in 0.614s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Lock "cinder-quobyte-ed93b25b-8092-4d3b-9017-8a991b8a3fd6" released by "delete_volume" :: held 1.233s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:28 devstack sudo[84183]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccbb36c1-7010-4d4e-9307-728490199310" returned: 0 in 0.630s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Lock "cinder-quobyte-ccbb36c1-7010-4d4e-9307-728490199310" released by "delete_volume" :: held 1.477s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Created reservations ['64052123-331e-452f-827e-be03b8674205', 'fd014e8a-1af2-4d74-baed-cc7d2e22b10c', '1004098c-6b37-4665-aa6b-f8e0d7feefe6', '771f0dd7-5033-44eb-9427-440b789ee214'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Created reservations ['af81b79e-5ff3-468e-acc0-996793134c82', 'f10cc4ee-0a93-4471-8b8e-2d6dc43023fe', '40a7154c-f5b2-4e07-bbe7-1cb9830c49e5', '8ae6eab2-ec3d-472d-ab95-77e17da442c6'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:28 devstack sudo[84188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:28 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:28 devstack sudo[84189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:28 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:29 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.581s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:29 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Deleted volume successfully.
Apr 13 17:05:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59292f96-5cdd-4f29-9a00-bbb75268b8bb tempest-DeleteServersTestJSON-1192795968 None] Lock "cinder-ed93b25b-8092-4d3b-9017-8a991b8a3fd6-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:29 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.841s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:29 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Deleted volume successfully.
Apr 13 17:05:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b7c2b43-03e7-4579-bd26-50d74da4c003 tempest-VolumesTestJSON-196725901 None] Lock "cinder-ccbb36c1-7010-4d4e-9307-728490199310-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6742bff0-c135-4398-b00b-30ffc8b8c0fb tempest-GroupSnapshotsTest-1324007362 None] Group tempest-GroupSnapshotsTest-Group-2101166628: creating
Apr 13 17:05:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6742bff0-c135-4398-b00b-30ffc8b8c0fb tempest-GroupSnapshotsTest-1324007362 None] Group tempest-GroupSnapshotsTest-Group-2101166628: created successfully
Apr 13 17:05:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6742bff0-c135-4398-b00b-30ffc8b8c0fb tempest-GroupSnapshotsTest-1324007362 None] Create group completed successfully.
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (f0a57991-95c8-47fa-95f6-90e1cba41cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2057185a-abbb-4c7c-a945-154f0a37e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2057185a-abbb-4c7c-a945-154f0a37e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1077145536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01dad1e5-6810-49b0-9dd6-4db430694354,host='devstack@QuobyteHD#QuobyteHD',id=9ee69c57-b0ae-4de6-be15-93970e6fae2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:37Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d07cd86b-730a-46ea-a8e2-7974dfcfb00a),volume_type_id=d07cd86b-730a-46ea-a8e2-7974dfcfb00a)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ec8aad-67b9-4012-b84b-ebeca61df42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ec8aad-67b9-4012-b84b-ebeca61df42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6c6b87-b92b-438a-9f9a-5584ba8903f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6c6b87-b92b-438a-9f9a-5584ba8903f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee69c57-b0ae-4de6-be15-93970e6fae2b', 'volume_name': 'volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b191d20-37b2-4480-b591-9563a8effe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b191d20-37b2-4480-b591-9563a8effe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6c4689-5eab-4674-b562-d0ab143635fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Volume 9ee69c57-b0ae-4de6-be15-93970e6fae2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b', 'volume_size': 1}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=01dad1e5-6810-49b0-9dd6-4db430694354,created_at=2026-04-13T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1077145536',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=01dad1e5-6810-49b0-9dd6-4db430694354,host='devstack@QuobyteHD#QuobyteHD',id=9ee69c57-b0ae-4de6-be15-93970e6fae2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:37Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d07cd86b-730a-46ea-a8e2-7974dfcfb00a),volume_type_id=d07cd86b-730a-46ea-a8e2-7974dfcfb00a)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Creating volume 9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:37 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:37 devstack sudo[84245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b 1073741824
Apr 13 17:05:37 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:38 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b 1073741824" returned: 0 in 0.759s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:38 devstack sudo[84254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b
Apr 13 17:05:38 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:38 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b" returned: 0 in 0.639s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6c4689-5eab-4674-b562-d0ab143635fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483eabad-e2a3-4b5b-9913-86e0d02534ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Volume volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b (9ee69c57-b0ae-4de6-be15-93970e6fae2b): created successfully
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483eabad-e2a3-4b5b-9913-86e0d02534ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (f0a57991-95c8-47fa-95f6-90e1cba41cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ca3c2d98-f167-493b-8b28-6f465523e4d0 tempest-GroupSnapshotsTest-1324007362 None] Created volume successfully.
Apr 13 17:05:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] GroupSnapshot a8c9f7fe-2d9b-404b-bb76-61251ead4f80: creating.
Apr 13 17:05:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Group snapshot a8c9f7fe-2d9b-404b-bb76-61251ead4f80: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 17:05:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Creating offline snapshot f2938561-6ed0-429e-bce3-25c58a38fab2 of volume 9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:05:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8539fce3-844f-4d2c-9c1a-bca20bc3f6f5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:40 devstack sudo[84260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b
Apr 13 17:05:40 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:41 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b" returned: 0 in 1.276s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:41 devstack sudo[84266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 1G
Apr 13 17:05:41 devstack sudo[84266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:42 devstack sudo[84266]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 1G" returned: 0 in 1.357s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:42 devstack sudo[84288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2
Apr 13 17:05:42 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:43 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2" returned: 0 in 1.166s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:43 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:05:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:43 devstack sudo[84294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2
Apr 13 17:05:43 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:44 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2" returned: 0 in 1.005s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:44 devstack sudo[84298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.info
Apr 13 17:05:44 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:45 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.info" returned: 0 in 1.013s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:45 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:05:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:45 devstack sudo[84323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.info
Apr 13 17:05:45 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:46 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.info" returned: 0 in 0.766s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.703s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2247edd2-5a05-4b1f-ac0a-9bb82e3c37e8 tempest-GroupSnapshotsTest-1324007362 None] group_snapshot a8c9f7fe-2d9b-404b-bb76-61251ead4f80: created successfully
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-f2938561-6ed0-429e-bce3-25c58a38fab2-c7eec85c-cb08-4f66-a729-6b5481d96336" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-f2938561-6ed0-429e-bce3-25c58a38fab2-c7eec85c-cb08-4f66-a729-6b5481d96336" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Creating volume c7eec85c-cb08-4f66-a729-6b5481d96336 from snapshot f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-c7eec85c-cb08-4f66-a729-6b5481d96336" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-c7eec85c-cb08-4f66-a729-6b5481d96336" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] snapshot: f2938561-6ed0-429e-bce3-25c58a38fab2, volume: c7eec85c-cb08-4f66-a729-6b5481d96336,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[04075978-3515-4248-9455-282a1f35392a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:49 devstack sudo[84334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2
Apr 13 17:05:49 devstack sudo[84334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:50 devstack sudo[84334]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2" returned: 0 in 0.891s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94a2444-ac4a-4e14-9af9-ddab26dd1d27]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:50 devstack sudo[84344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b
Apr 13 17:05:50 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:50 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b" returned: 0 in 0.706s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:05:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:50 devstack sudo[84358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336
Apr 13 17:05:50 devstack sudo[84358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:54 devstack sudo[84358]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336" returned: 0 in 3.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a3bf14-a8a5-496d-8d73-8b81a2e36cd5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:54 devstack sudo[84423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b
Apr 13 17:05:54 devstack sudo[84423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=66,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=23 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=72,cinder:SELECT=56,cinder:INSERT=9,cinder:DELETE=6 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Flow 'volume_create_manager' (da2e0335-4f67-4310-842f-e490df376830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a88d43-e0fa-4f14-b887-4ac9085d1efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a88d43-e0fa-4f14-b887-4ac9085d1efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1044189484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371dcc11-4d6d-4e94-a5c7-49faa07eaf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11dc1390d2f74fd8bec73545e460b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:55Z,use_quota=True,user_id='e5f1520f5ace4a6d8b5caf75c479ce9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ab803f-e637-40cc-95fd-dfa872b58575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ab803f-e637-40cc-95fd-dfa872b58575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ea0e13-357b-4394-bb2b-578b8bafaf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ea0e13-357b-4394-bb2b-578b8bafaf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371dcc11-4d6d-4e94-a5c7-49faa07eaf86', 'volume_name': 'volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cbcf2d-363a-49f3-8895-468241d7b4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23cbcf2d-363a-49f3-8895-468241d7b4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db71d90-a28a-4991-ab30-7cac987aedee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Volume 371dcc11-4d6d-4e94-a5c7-49faa07eaf86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86', 'volume_size': 1}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:55 devstack sudo[84423]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b" returned: 0 in 1.022s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b, size 1024.00 MB, duration 3.56 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:05:55 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Converted 1024.00 MB image at 287.65 MB/s
Apr 13 17:05:55 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:55 devstack sudo[84438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336
Apr 13 17:05:55 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:55 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336" returned: 0 in 0.437s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-c7eec85c-cb08-4f66-a729-6b5481d96336" released by "_copy_volume_from_snapshot" :: held 6.686s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-f2938561-6ed0-429e-bce3-25c58a38fab2-c7eec85c-cb08-4f66-a729-6b5481d96336" released by "_create_volume_from_snapshot" :: held 6.718s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.733s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1044189484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371dcc11-4d6d-4e94-a5c7-49faa07eaf86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11dc1390d2f74fd8bec73545e460b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:55Z,use_quota=True,user_id='e5f1520f5ace4a6d8b5caf75c479ce9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Creating volume 371dcc11-4d6d-4e94-a5c7-49faa07eaf86 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:55 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:56 devstack sudo[84441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86 1073741824
Apr 13 17:05:56 devstack sudo[84441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e34e5e8b-f7b2-4087-b388-a0951b2165e8 tempest-GroupSnapshotsTest-1324007362 None] Create group from source-snapshot-a8c9f7fe-2d9b-404b-bb76-61251ead4f80 completed successfully.
Apr 13 17:05:56 devstack sudo[84441]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86 1073741824" returned: 0 in 0.626s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:56 devstack sudo[84446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86
Apr 13 17:05:56 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:57 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db71d90-a28a-4991-ab30-7cac987aedee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f90afe7-ab0a-430c-9f16-e56a162f25c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:57 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Volume volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86 (371dcc11-4d6d-4e94-a5c7-49faa07eaf86): created successfully
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f90afe7-ab0a-430c-9f16-e56a162f25c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Flow 'volume_create_manager' (da2e0335-4f67-4310-842f-e490df376830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c1121e96-3488-4458-ba35-4d0925a779a4 tempest-ServersNegativeTestJSON-355606737 None] Created volume successfully.
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-c7eec85c-cb08-4f66-a729-6b5481d96336" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-c7eec85c-cb08-4f66-a729-6b5481d96336" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0aa860-a142-4dcb-8709-daecaafc5701]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:05:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:57 devstack sudo[84466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336
Apr 13 17:05:57 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Flow 'volume_create_manager' (0240aed8-0624-44ce-beb5-47f3125e3688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8538f798-d029-428c-8f4c-97fe561978a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8538f798-d029-428c-8f4c-97fe561978a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2078216620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7caf10c-9614-4f4a-9f88-3bfe94f3b368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11dc1390d2f74fd8bec73545e460b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:58Z,use_quota=True,user_id='e5f1520f5ace4a6d8b5caf75c479ce9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a5f88c-a7af-4700-94a8-d29da67713b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a5f88c-a7af-4700-94a8-d29da67713b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb3703c-8d43-4008-aa73-8079ca757840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb3703c-8d43-4008-aa73-8079ca757840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7caf10c-9614-4f4a-9f88-3bfe94f3b368', 'volume_name': 'volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f34a53-04a6-4c46-9bc0-dfd9fa1f1b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59f34a53-04a6-4c46-9bc0-dfd9fa1f1b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaaaa535-7d92-4def-982c-fdd909ab4c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Volume f7caf10c-9614-4f4a-9f88-3bfe94f3b368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368', 'volume_size': 1}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2078216620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7caf10c-9614-4f4a-9f88-3bfe94f3b368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11dc1390d2f74fd8bec73545e460b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:05:58Z,use_quota=True,user_id='e5f1520f5ace4a6d8b5caf75c479ce9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Creating volume f7caf10c-9614-4f4a-9f88-3bfe94f3b368 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:05:58 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:58 devstack sudo[84472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368 1073741824
Apr 13 17:05:58 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:58 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:58 devstack sudo[84475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336
Apr 13 17:05:58 devstack sudo[84475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:58 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368 1073741824" returned: 0 in 0.598s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:58 devstack sudo[84475]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c7eec85c-cb08-4f66-a729-6b5481d96336" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-c7eec85c-cb08-4f66-a729-6b5481d96336" released by "delete_volume" :: held 1.165s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:05:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['4122fc90-18db-4dc9-99c0-76393b32bf1f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:59 devstack sudo[84481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368
Apr 13 17:05:59 devstack sudo[84481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:59 devstack cinder-volume[82641]: WARNING cinder.quota [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-28425934 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-28425934, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:05:59 devstack cinder-volume[82641]: WARNING cinder.quota [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-28425934 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-28425934, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['c5bdb2f7-daaf-4936-b581-e5f504ca6e4b', '239a41d6-af8d-4753-896c-f056f07609d4', 'e37d73fb-3a02-4dba-b477-3615240af07e', '9c2c70d9-0e9f-4dbd-9f20-01b2b2ca0632'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:05:59 devstack sudo[84484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:05:59 devstack sudo[84484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:05:59 devstack sudo[84481]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaaaa535-7d92-4def-982c-fdd909ab4c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf23309-82ac-47fc-93cb-a8fe7f0f646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:05:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Volume volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368 (f7caf10c-9614-4f4a-9f88-3bfe94f3b368): created successfully
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf23309-82ac-47fc-93cb-a8fe7f0f646b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Flow 'volume_create_manager' (0240aed8-0624-44ce-beb5-47f3125e3688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:05:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3c0f8f2d-72aa-44b0-9da9-00b06c2e4501 tempest-ServersNegativeTestJSON-355606737 None] Created volume successfully.
Apr 13 17:05:59 devstack sudo[84484]: pam_unix(sudo:session): session closed for user root
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:05:59 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:05:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-be9d2c17-fca2-4e26-a1ed-0bee8645f6a8 tempest-GroupSnapshotsTest-1324007362 None] Delete group completed successfully.
Apr 13 17:06:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] group_snapshot a8c9f7fe-2d9b-404b-bb76-61251ead4f80: deleting
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] group_snapshot a8c9f7fe-2d9b-404b-bb76-61251ead4f80: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-9ee69c57-b0ae-4de6-be15-93970e6fae2b" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-9ee69c57-b0ae-4de6-be15-93970e6fae2b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-f2938561-6ed0-429e-bce3-25c58a38fab2" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-f2938561-6ed0-429e-bce3-25c58a38fab2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Deleting offline snapshot f2938561-6ed0-429e-bce3-25c58a38fab2 of volume 9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] snapshot_file for this snap is: volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b442654-e2d8-4073-9ee4-3b28d36a4eea]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:00 devstack sudo[84490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2
Apr 13 17:06:00 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "cinder-f7caf10c-9614-4f4a-9f88-3bfe94f3b368-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-f7caf10c-9614-4f4a-9f88-3bfe94f3b368-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "cinder-quobyte-f7caf10c-9614-4f4a-9f88-3bfe94f3b368" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-quobyte-f7caf10c-9614-4f4a-9f88-3bfe94f3b368" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b7feb7-1da4-4eb2-8716-f301e6b597a3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:00 devstack sudo[84504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368
Apr 13 17:06:00 devstack sudo[84504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:00 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2" returned: 0 in 0.689s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6823409c-afa3-46ec-9c3f-62695681f298]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:00 devstack sudo[84511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b
Apr 13 17:06:00 devstack sudo[84511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:01 devstack sudo[84504]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368" returned: 0 in 0.650s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:01 devstack sudo[84521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368
Apr 13 17:06:01 devstack sudo[84521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:01 devstack sudo[84511]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b" returned: 0 in 0.674s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:01 devstack sudo[84526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2
Apr 13 17:06:01 devstack sudo[84526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:01 devstack sudo[84521]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f7caf10c-9614-4f4a-9f88-3bfe94f3b368" returned: 0 in 0.530s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-quobyte-f7caf10c-9614-4f4a-9f88-3bfe94f3b368" released by "delete_volume" :: held 1.205s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Created reservations ['53014c38-3ddd-468f-9070-eb753292cb27', '74cf3c48-8b9d-46ae-afb5-4973ebab3ad0', 'f69fbf1c-e5b4-4249-8088-1f9877c06eb1', 'aa6d0629-69da-4617-abd0-1e45d61e0321'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:02 devstack sudo[84533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:06:02 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:02 devstack sudo[84526]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2" returned: 0 in 0.764s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:02 devstack sudo[84535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2
Apr 13 17:06:02 devstack sudo[84535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "cinder-371dcc11-4d6d-4e94-a5c7-49faa07eaf86-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-371dcc11-4d6d-4e94-a5c7-49faa07eaf86-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "cinder-quobyte-371dcc11-4d6d-4e94-a5c7-49faa07eaf86" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-quobyte-371dcc11-4d6d-4e94-a5c7-49faa07eaf86" acquired by "delete_volume" :: waited 0.049s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d20e4e9-b8ab-43ee-900a-a1bb60585799]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:03 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.242s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:06:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Deleted volume successfully.
Apr 13 17:06:03 devstack sudo[84535]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b.f2938561-6ed0-429e-bce3-25c58a38fab2" returned: 0 in 1.042s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:03 devstack sudo[84579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-f2938561-6ed0-429e-bce3-25c58a38fab2" released by "_delete_snapshot" :: held 3.247s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8b80b5ce-c345-411b-8c5b-4f88006172ca tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-f7caf10c-9614-4f4a-9f88-3bfe94f3b368-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:03 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-9ee69c57-b0ae-4de6-be15-93970e6fae2b" released by "delete_snapshot" :: held 3.267s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:03 devstack cinder-volume[82641]: WARNING cinder.quota [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-28425934 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-28425934, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['2161d68c-479e-4455-87c8-f7803e81f34f', '16e97928-912c-425c-b434-10e5dd494ef0', 'b60befee-e518-4f79-96a5-a1c999acd432', 'b99a5bf5-47aa-40cc-8b9e-bc7afa767391'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-439ee9df-804f-4814-a543-991f627d4ffe tempest-GroupSnapshotsTest-1324007362 None] group_snapshot a8c9f7fe-2d9b-404b-bb76-61251ead4f80: deleted successfully
Apr 13 17:06:03 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86" returned: 0 in 0.658s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:03 devstack sudo[84590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86
Apr 13 17:06:03 devstack sudo[84590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:04 devstack sudo[84590]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-371dcc11-4d6d-4e94-a5c7-49faa07eaf86" returned: 0 in 0.430s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-quobyte-371dcc11-4d6d-4e94-a5c7-49faa07eaf86" released by "delete_volume" :: held 1.173s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Created reservations ['d01ef9f0-66fb-4063-b0b4-012da74817f6', '135bdc63-1811-4938-a38d-ad80978552bd', 'e6adc896-c0d0-48fb-a4c4-d48a3e87b30c', '6690d3ce-1633-42e5-b495-e57b0c2e6dcb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:04 devstack sudo[84596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:06:04 devstack sudo[84596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-9ee69c57-b0ae-4de6-be15-93970e6fae2b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-9ee69c57-b0ae-4de6-be15-93970e6fae2b" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[74049276-c7dd-498a-b960-a38fb8b6dfc5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:04 devstack sudo[84598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b
Apr 13 17:06:04 devstack sudo[84598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:04 devstack sudo[84596]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:06:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Deleted volume successfully.
Apr 13 17:06:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-027fd806-2f6b-4f73-a3e2-6f04d42fd766 tempest-ServersNegativeTestJSON-355606737 None] Lock "cinder-371dcc11-4d6d-4e94-a5c7-49faa07eaf86-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:05 devstack sudo[84598]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b" returned: 0 in 0.705s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:05 devstack sudo[84606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b
Apr 13 17:06:05 devstack sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:06 devstack sudo[84606]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9ee69c57-b0ae-4de6-be15-93970e6fae2b" returned: 0 in 0.741s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-9ee69c57-b0ae-4de6-be15-93970e6fae2b" released by "delete_volume" :: held 1.503s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['198ebdcd-039b-40bd-be37-01c744413d14'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:06 devstack cinder-volume[82641]: WARNING cinder.db.sqlalchemy.api [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-28425934']
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['0c5a560a-30bb-4b34-be7f-39903bc6f3c1', 'ef9d83af-ce3c-4e73-9c41-b7ad7ecada5f', '86b59863-e86b-4fbf-ba52-6ebf7647f90e', '3f93dc33-a11e-4029-9f51-20a7074b0cbe'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:06 devstack sudo[84652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:06:06 devstack sudo[84652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1ca5557f-d316-4f73-9b2e-d5c1b4e0ef45 tempest-GroupSnapshotsTest-1324007362 None] Group tempest-GroupSnapshotsTest-Group-86033641: creating
Apr 13 17:06:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1ca5557f-d316-4f73-9b2e-d5c1b4e0ef45 tempest-GroupSnapshotsTest-1324007362 None] Group tempest-GroupSnapshotsTest-Group-86033641: created successfully
Apr 13 17:06:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1ca5557f-d316-4f73-9b2e-d5c1b4e0ef45 tempest-GroupSnapshotsTest-1324007362 None] Create group completed successfully.
Apr 13 17:06:07 devstack sudo[84652]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.384s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:07 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:06:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0e311843-33d2-4a09-9a6d-af5efadc49cf tempest-GroupSnapshotsTest-1324007362 None] Delete group completed successfully.
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (be2fe4b2-f9c9-417d-99a5-44cbafb8f0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfbd69-8a9d-4db9-a693-1d0d85b5400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bfbd69-8a9d-4db9-a693-1d0d85b5400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1639816310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63ce9913-17dc-40de-ba3e-57923fed9013,host='devstack@QuobyteHD#QuobyteHD',id=efab8381-c55b-4f4a-b5b4-bd852a76d23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:10Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0674c0aa-ea42-49f2-9538-5ce6cd02ec49),volume_type_id=0674c0aa-ea42-49f2-9538-5ce6cd02ec49)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0897db-268e-4013-816e-71d417ccab84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0897db-268e-4013-816e-71d417ccab84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8f0c67-9cab-4425-8659-400283638a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8f0c67-9cab-4425-8659-400283638a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efab8381-c55b-4f4a-b5b4-bd852a76d23f', 'volume_name': 'volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd713d6-7c65-43e4-8bb9-01979eb3d785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd713d6-7c65-43e4-8bb9-01979eb3d785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1209c452-6ef3-4726-8a84-b61fa22ebceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Volume efab8381-c55b-4f4a-b5b4-bd852a76d23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f', 'volume_size': 1}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=63ce9913-17dc-40de-ba3e-57923fed9013,created_at=2026-04-13T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1639816310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63ce9913-17dc-40de-ba3e-57923fed9013,host='devstack@QuobyteHD#QuobyteHD',id=efab8381-c55b-4f4a-b5b4-bd852a76d23f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:10Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0674c0aa-ea42-49f2-9538-5ce6cd02ec49),volume_type_id=0674c0aa-ea42-49f2-9538-5ce6cd02ec49)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Creating volume efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:06:09 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:06:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:09 devstack sudo[84725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f 1073741824
Apr 13 17:06:09 devstack sudo[84725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:10 devstack sudo[84725]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f 1073741824" returned: 0 in 0.757s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:10 devstack sudo[84731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f
Apr 13 17:06:10 devstack sudo[84731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:11 devstack sudo[84731]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f" returned: 0 in 1.021s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:06:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1209c452-6ef3-4726-8a84-b61fa22ebceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bec4031-32da-4ac3-8cf5-d16eba591b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Volume volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f (efab8381-c55b-4f4a-b5b4-bd852a76d23f): created successfully
Apr 13 17:06:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bec4031-32da-4ac3-8cf5-d16eba591b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (be2fe4b2-f9c9-417d-99a5-44cbafb8f0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ec70372a-523d-4d42-b18f-9a07940e8cf5 tempest-GroupSnapshotsTest-1324007362 None] Created volume successfully.
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (a0b0f9e8-5fb3-4a14-8ab6-a36926d54216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75025da-a1b5-4f29-98ee-1712cfa5b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75025da-a1b5-4f29-98ee-1712cfa5b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451776392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63ce9913-17dc-40de-ba3e-57923fed9013,host='devstack@QuobyteHD#QuobyteHD',id=4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:12Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0674c0aa-ea42-49f2-9538-5ce6cd02ec49),volume_type_id=0674c0aa-ea42-49f2-9538-5ce6cd02ec49)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664dd843-cbed-4456-9985-9913f0096264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664dd843-cbed-4456-9985-9913f0096264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5202fc51-d306-471d-9308-048b3c0985fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5202fc51-d306-471d-9308-048b3c0985fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c', 'volume_name': 'volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c188bd-0fd2-4372-8008-b1718a37e5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c188bd-0fd2-4372-8008-b1718a37e5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b9d874-a750-4c11-a88d-274d3e38d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Volume 4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c', 'volume_size': 1}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=63ce9913-17dc-40de-ba3e-57923fed9013,created_at=2026-04-13T15:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451776392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=63ce9913-17dc-40de-ba3e-57923fed9013,host='devstack@QuobyteHD#QuobyteHD',id=4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:12Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0674c0aa-ea42-49f2-9538-5ce6cd02ec49),volume_type_id=0674c0aa-ea42-49f2-9538-5ce6cd02ec49)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Creating volume 4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:06:12 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:12 devstack sudo[84740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c 1073741824
Apr 13 17:06:12 devstack sudo[84740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:12 devstack sudo[84743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:06:12 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:13 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:06:14 devstack sudo[84740]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c 1073741824" returned: 0 in 1.935s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:14 devstack sudo[84771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c
Apr 13 17:06:14 devstack sudo[84771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:15 devstack sudo[84771]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" returned: 0 in 0.934s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] <== create_volume: return (2922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:06:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.924s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b9d874-a750-4c11-a88d-274d3e38d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b370c16-b8a1-4eb9-9e48-2e7fae23bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Volume volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c (4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c): created successfully
Apr 13 17:06:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b370c16-b8a1-4eb9-9e48-2e7fae23bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (a0b0f9e8-5fb3-4a14-8ab6-a36926d54216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8c55d7c3-f1c7-4a80-aecf-a41ef49fcfa1 tempest-GroupSnapshotsTest-1324007362 None] Created volume successfully.
Apr 13 17:06:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1cae4c22-9d0e-4153-8aac-6ea0f7944ff2 tempest-GroupSnapshotsTest-1324007362 None] Update group completed successfully.
Apr 13 17:06:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-74bda177-8886-4434-a8eb-f64a2c4fa4c5 tempest-GroupSnapshotsTest-1324007362 None] Update group completed successfully.
Apr 13 17:06:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-09a4d898-c6ab-4623-9bb1-5395e68e5fae tempest-GroupSnapshotsTest-1324007362 None] Update group completed successfully.
Apr 13 17:06:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-af23bd2e-b3f9-46ff-8956-cd5bd777254d tempest-GroupSnapshotsTest-1324007362 None] Update group completed successfully.
Apr 13 17:06:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] GroupSnapshot 36f6ca39-8f92-446b-837b-149339ae9982: creating.
Apr 13 17:06:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Group snapshot 36f6ca39-8f92-446b-837b-149339ae9982: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 17:06:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Creating offline snapshot 7e944344-0c3f-4105-bd45-cd909f974d2f of volume efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:06:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc449f-b1e5-4bbe-8da3-62f958242e5f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:22 devstack sudo[84849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f
Apr 13 17:06:22 devstack sudo[84849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:22 devstack sudo[84849]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f" returned: 0 in 0.664s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:22 devstack sudo[84854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f 1G
Apr 13 17:06:22 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Flow 'volume_create_manager' (5d63400c-72c0-4eba-99c4-b7af87ca1c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a229f9-b581-422b-922a-f3ca30d2b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a229f9-b581-422b-922a-f3ca30d2b16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1845888543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c056144-b86b-4f8d-beed-a06ed40bd533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0002c65a7e594ea19082a93e835d196c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:23Z,use_quota=True,user_id='140ca180cbc84498ab0d7ea4ea2036a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4441aad4-9852-444a-95ab-8f7fe532f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4441aad4-9852-444a-95ab-8f7fe532f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff10a1d-362c-410f-bbf4-0bcafb6c9a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ff10a1d-362c-410f-bbf4-0bcafb6c9a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c056144-b86b-4f8d-beed-a06ed40bd533', 'volume_name': 'volume-3c056144-b86b-4f8d-beed-a06ed40bd533', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4553956b-5496-46d9-abb1-dcb8f9bf2a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4553956b-5496-46d9-abb1-dcb8f9bf2a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ef4d0b-2e2a-4e55-84bf-f1aa872c42f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Volume 3c056144-b86b-4f8d-beed-a06ed40bd533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c056144-b86b-4f8d-beed-a06ed40bd533', 'volume_size': 1}
Apr 13 17:06:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Flow 'volume_create_manager' (2ea4ec32-1bf8-451f-9c27-eebeb404cf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8c21e-ca92-4c04-9af4-ac28317281f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea8c21e-ca92-4c04-9af4-ac28317281f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-597895564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bd5dfd-747a-4f22-a859-61a802afa326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ee865ca0604f7c94486490fb4d0b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:24Z,use_quota=True,user_id='5f9ce7057126407781e4932fc2f1d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04cf5db-5aeb-4498-a6bd-6b691d038e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d04cf5db-5aeb-4498-a6bd-6b691d038e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921d86d4-bf69-4b7d-8021-e614fcdf080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921d86d4-bf69-4b7d-8021-e614fcdf080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8bd5dfd-747a-4f22-a859-61a802afa326', 'volume_name': 'volume-b8bd5dfd-747a-4f22-a859-61a802afa326', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f66c20-1862-44b6-a105-9b3562c4aca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f66c20-1862-44b6-a105-9b3562c4aca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54005b63-1c1e-4d41-9055-639069f7e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Volume b8bd5dfd-747a-4f22-a859-61a802afa326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8bd5dfd-747a-4f22-a859-61a802afa326', 'volume_size': 1}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:24 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f 1G" returned: 0 in 2.255s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:24 devstack sudo[84860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f
Apr 13 17:06:24 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Flow 'volume_create_manager' (21f727c1-6103-4ece-8c52-b5456bdece7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590bc461-300e-40d1-af05-a7afbe3d12ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590bc461-300e-40d1-af05-a7afbe3d12ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:25Z,deleted=False,deleted_at=None,display_description='',display_name='5d1bea51-f582-4eb7-89ba-ba6450c375a2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9820fd84-ae51-419b-a552-9cef76e865a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da47858d1fcc447790d7d8581673a9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:25Z,use_quota=True,user_id='246c87d66d034b28b51d4d66a72f350f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2ae8c5-38ca-46d2-b1f2-e59d028ed060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2ae8c5-38ca-46d2-b1f2-e59d028ed060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68051fa1-a8f2-4442-a224-e64614914356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68051fa1-a8f2-4442-a224-e64614914356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9820fd84-ae51-419b-a552-9cef76e865a1', 'volume_name': 'volume-9820fd84-ae51-419b-a552-9cef76e865a1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c3b476-735e-45a7-b32b-ee663d6ae3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c3b476-735e-45a7-b32b-ee663d6ae3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2023fe63-f956-4f15-b03c-308291881ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Volume 9820fd84-ae51-419b-a552-9cef76e865a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9820fd84-ae51-419b-a552-9cef76e865a1', 'volume_size': 1}
Apr 13 17:06:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:26 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f" returned: 0 in 1.116s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:26 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:06:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:26 devstack sudo[84866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f
Apr 13 17:06:26 devstack sudo[84866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:26 devstack sudo[84866]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:26 devstack sudo[84871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.info
Apr 13 17:06:26 devstack sudo[84871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:27 devstack sudo[84871]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.info" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:27 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:27 devstack sudo[84874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.info
Apr 13 17:06:27 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:27 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.info" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.754s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Creating offline snapshot d48b305e-7ae3-4e13-9944-0f7ee434c9b0 of volume 4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c71271-0501-475e-b096-d59a494ca6a8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:27 devstack sudo[84877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c
Apr 13 17:06:27 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:28 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" returned: 0 in 0.735s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:28 devstack sudo[84882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 1G
Apr 13 17:06:28 devstack sudo[84882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:29 devstack sudo[84882]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 1G" returned: 0 in 0.700s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:29 devstack sudo[84888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0
Apr 13 17:06:29 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:29 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:29 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:06:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:29 devstack sudo[84893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0
Apr 13 17:06:29 devstack sudo[84893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:30 devstack sudo[84893]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:30 devstack sudo[84896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.info
Apr 13 17:06:30 devstack sudo[84896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:30 devstack sudo[84896]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.info" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:30 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:06:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:30 devstack sudo[84931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.info
Apr 13 17:06:30 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:31 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.info" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.514s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.849s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-597895564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8bd5dfd-747a-4f22-a859-61a802afa326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3ee865ca0604f7c94486490fb4d0b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:24Z,use_quota=True,user_id='5f9ce7057126407781e4932fc2f1d8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Creating volume b8bd5dfd-747a-4f22-a859-61a802afa326 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:06:31 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:31 devstack sudo[84934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326 1073741824
Apr 13 17:06:31 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-455ba2ae-c8bc-4eb4-af89-85837261b577 tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 36f6ca39-8f92-446b-837b-149339ae9982: created successfully
Apr 13 17:06:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 36f6ca39-8f92-446b-837b-149339ae9982: deleting
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 36f6ca39-8f92-446b-837b-149339ae9982: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-efab8381-c55b-4f4a-b5b4-bd852a76d23f" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-efab8381-c55b-4f4a-b5b4-bd852a76d23f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-7e944344-0c3f-4105-bd45-cd909f974d2f" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-7e944344-0c3f-4105-bd45-cd909f974d2f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Deleting offline snapshot 7e944344-0c3f-4105-bd45-cd909f974d2f of volume efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] snapshot_file for this snap is: volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a061408-9abc-4dd6-84e8-3d11af57aa40]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:32 devstack sudo[84938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f
Apr 13 17:06:32 devstack sudo[84938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:32 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326 1073741824" returned: 0 in 1.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:32 devstack sudo[84944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326
Apr 13 17:06:32 devstack sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:32 devstack sudo[84938]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f" returned: 0 in 0.620s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75278e-e438-407e-8183-0de43dd133d1]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:32 devstack sudo[84946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f
Apr 13 17:06:32 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:33 devstack sudo[84944]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326" returned: 0 in 0.822s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.822s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:25Z,deleted=False,deleted_at=None,display_description='',display_name='5d1bea51-f582-4eb7-89ba-ba6450c375a2-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9820fd84-ae51-419b-a552-9cef76e865a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da47858d1fcc447790d7d8581673a9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:25Z,use_quota=True,user_id='246c87d66d034b28b51d4d66a72f350f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Creating volume 9820fd84-ae51-419b-a552-9cef76e865a1 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:06:33 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54005b63-1c1e-4d41-9055-639069f7e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8bd5dfd-747a-4f22-a859-61a802afa326', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535053d6-6b7b-4d55-b96e-0b228c4f0c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:33 devstack sudo[84953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1 1073741824
Apr 13 17:06:33 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f" returned: 0 in 0.719s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:33 devstack sudo[84953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Volume volume-b8bd5dfd-747a-4f22-a859-61a802afa326 (b8bd5dfd-747a-4f22-a859-61a802afa326): created successfully
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (535053d6-6b7b-4d55-b96e-0b228c4f0c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Flow 'volume_create_manager' (2ea4ec32-1bf8-451f-9c27-eebeb404cf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:33 devstack sudo[84955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f
Apr 13 17:06:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b93f04b4-79ec-4779-a76e-cc680b70755d tempest-ServerRescueNegativeTestJSON-159923319 None] Created volume successfully.
Apr 13 17:06:33 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:34 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f" returned: 0 in 0.709s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:34 devstack sudo[84964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f
Apr 13 17:06:34 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:34 devstack sudo[84953]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1 1073741824" returned: 0 in 0.981s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:34 devstack sudo[84966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1
Apr 13 17:06:34 devstack sudo[84966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:35 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f.7e944344-0c3f-4105-bd45-cd909f974d2f" returned: 0 in 0.801s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-7e944344-0c3f-4105-bd45-cd909f974d2f" released by "_delete_snapshot" :: held 3.136s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-efab8381-c55b-4f4a-b5b4-bd852a76d23f" released by "delete_snapshot" :: held 3.160s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-d48b305e-7ae3-4e13-9944-0f7ee434c9b0" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-d48b305e-7ae3-4e13-9944-0f7ee434c9b0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Deleting offline snapshot d48b305e-7ae3-4e13-9944-0f7ee434c9b0 of volume 4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:06:35 devstack sudo[84966]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] snapshot_file for this snap is: volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1" returned: 0 in 0.707s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.721s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1845888543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c056144-b86b-4f8d-beed-a06ed40bd533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0002c65a7e594ea19082a93e835d196c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:23Z,use_quota=True,user_id='140ca180cbc84498ab0d7ea4ea2036a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Creating volume 3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:06:35 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb5973f-eeda-4e4e-ad69-c07f89505b25]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:35 devstack sudo[85006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 1073741824
Apr 13 17:06:35 devstack sudo[85006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2023fe63-f956-4f15-b03c-308291881ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9820fd84-ae51-419b-a552-9cef76e865a1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6cd0d2-15d5-48e4-b821-3eca33012ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:35 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Volume volume-9820fd84-ae51-419b-a552-9cef76e865a1 (9820fd84-ae51-419b-a552-9cef76e865a1): created successfully
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6cd0d2-15d5-48e4-b821-3eca33012ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Flow 'volume_create_manager' (21f727c1-6103-4ece-8c52-b5456bdece7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:35 devstack sudo[85010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0
Apr 13 17:06:35 devstack sudo[85010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-44ff7e16-5dbf-4aea-a222-5957109e0ad3 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Created volume successfully.
Apr 13 17:06:36 devstack sudo[85010]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0" returned: 0 in 1.114s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:06:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ded4f4-25de-4708-8722-b131e695afa6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:36 devstack sudo[85018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c
Apr 13 17:06:36 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:36 devstack sudo[85006]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 1073741824" returned: 0 in 1.562s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:36 devstack sudo[85022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533
Apr 13 17:06:36 devstack sudo[85022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:37 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" returned: 0 in 0.739s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:37 devstack sudo[85025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0
Apr 13 17:06:37 devstack sudo[85025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:37 devstack sudo[85022]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533" returned: 0 in 0.727s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] <== create_volume: return (2333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.338s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ef4d0b-2e2a-4e55-84bf-f1aa872c42f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c056144-b86b-4f8d-beed-a06ed40bd533', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff05c64-a755-40f5-b1df-c8fca0c78fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Volume volume-3c056144-b86b-4f8d-beed-a06ed40bd533 (3c056144-b86b-4f8d-beed-a06ed40bd533): created successfully
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff05c64-a755-40f5-b1df-c8fca0c78fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Flow 'volume_create_manager' (5d63400c-72c0-4eba-99c4-b7af87ca1c47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-54f9edfd-5b0e-4c66-9fb2-7cbfb695c7b1 req-620e75e6-2c68-4670-8d43-9a932534d972 tempest-VolumesSnapshotsTestJSON-1618255982 None] Created volume successfully.
Apr 13 17:06:38 devstack sudo[85025]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0" returned: 0 in 0.926s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:38 devstack sudo[85044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0
Apr 13 17:06:38 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-b842a3bb-4e04-4a22-b3d9-20306aa13a5f tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-b842a3bb-4e04-4a22-b3d9-20306aa13a5f tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66cb549-874d-40f7-9872-477cd3a9d57d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-b842a3bb-4e04-4a22-b3d9-20306aa13a5f tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:38 devstack sudo[85066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1
Apr 13 17:06:38 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:38 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c.d48b305e-7ae3-4e13-9944-0f7ee434c9b0" returned: 0 in 0.733s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-d48b305e-7ae3-4e13-9944-0f7ee434c9b0" released by "_delete_snapshot" :: held 3.738s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" released by "delete_snapshot" :: held 3.775s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:38 devstack cinder-volume[82641]: WARNING cinder.quota [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-916958768 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-916958768, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:06:38 devstack cinder-volume[82641]: WARNING cinder.quota [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-916958768 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-916958768, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['1df95637-5daf-4176-9bef-da930689431f', 'f050d513-20e0-4aec-9324-10e33fec50b4', '4bc3cd6f-c088-4047-8d42-10722ceaaba4', '3d8e1ade-eaa1-449c-89be-36e20bc3348c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['3ccd82d2-5284-46c4-8714-4cf19f985928', 'b5779b37-037e-4254-932b-a5f061d35366', 'd17e861d-5015-4005-874d-5d3d81e7886e', '9e5e8be7-9f9b-4c8a-b172-7da6ec715371'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bc1c53a7-c710-4050-9036-75e0a7bec1ef tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 36f6ca39-8f92-446b-837b-149339ae9982: deleted successfully
Apr 13 17:06:39 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-b842a3bb-4e04-4a22-b3d9-20306aa13a5f tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1" returned: 0 in 1.112s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-b842a3bb-4e04-4a22-b3d9-20306aa13a5f tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.164s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.647s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-b842a3bb-4e04-4a22-b3d9-20306aa13a5f tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5', 'name': 'volume-9820fd84-ae51-419b-a552-9cef76e865a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8014a6f-a85d-4d17-865e-dba2a8710c04', 'enforce_multipath': True} {{(pid=82641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Creating offline snapshot 88179dce-9a6e-4d72-a075-2137458624f8 of volume 3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:06:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-96d350a8-cdff-4aa8-ad3c-847cbb6207f2 req-b842a3bb-4e04-4a22-b3d9-20306aa13a5f tempest-ServerBootFromVolumeStableRescueTest-505035589 None] attachment_update completed successfully.
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa45775-b4c2-4968-a716-7d510f47f039]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:39 devstack sudo[85081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533
Apr 13 17:06:39 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb67c97a-207d-4b91-924d-bd0a6e6122dc]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:40 devstack sudo[85083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c
Apr 13 17:06:40 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:40 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533" returned: 0 in 0.593s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:40 devstack sudo[85088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 1G
Apr 13 17:06:40 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:40 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" returned: 0 in 0.972s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:40 devstack sudo[85094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c
Apr 13 17:06:40 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:41 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 1G" returned: 0 in 1.130s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c056144-b86b-4f8d-beed-a06ed40bd533 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:41 devstack sudo[85100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c056144-b86b-4f8d-beed-a06ed40bd533 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8
Apr 13 17:06:41 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:41 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" returned: 0 in 0.620s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-4025fb0c-d7da-4c22-b1b2-2ffd40fbb15c" released by "delete_volume" :: held 1.681s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-efab8381-c55b-4f4a-b5b4-bd852a76d23f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-efab8381-c55b-4f4a-b5b4-bd852a76d23f" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9b5a8-2c10-4d8e-85ea-b78712e1de04]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:41 devstack sudo[85102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f
Apr 13 17:06:41 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:42 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c056144-b86b-4f8d-beed-a06ed40bd533 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8" returned: 0 in 0.895s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:42 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 is being set with open permissions: ugo+rw
Apr 13 17:06:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:42 devstack sudo[85175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8
Apr 13 17:06:42 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:42 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f" returned: 0 in 0.947s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:42 devstack sudo[85180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f
Apr 13 17:06:42 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:42 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:42 devstack sudo[85183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.info
Apr 13 17:06:42 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:43 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-efab8381-c55b-4f4a-b5b4-bd852a76d23f" returned: 0 in 0.581s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-efab8381-c55b-4f4a-b5b4-bd852a76d23f" released by "delete_volume" :: held 1.576s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['2c774fb4-8f78-46e9-9a25-2799bbf39a0d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:43 devstack cinder-volume[82641]: WARNING cinder.quota [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-916958768 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-916958768, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['d3ee0170-3bf4-4ed0-95f2-5578c2dbb594', '8a54ab9a-7fe8-4519-bdb4-f2ab4b7bf399', '050c1bed-4bb0-47bc-91a9-81e0a4fe4bf7', '20b6af5c-0d59-499d-b748-af6a07973d84'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['17fe0a03-458a-4610-8376-38127941f1b6', '9b4d842a-2580-44a8-868c-2958e5f392ac', 'c167dcdd-e773-48c4-b49c-1831173eeeb1', '2120cc81-1648-46ed-88a2-0f46c4a924db'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:43 devstack sudo[85226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:06:43 devstack sudo[85226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:44 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.info" returned: 0 in 1.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:44 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.info is being set with open permissions: ugo+rw
Apr 13 17:06:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:44 devstack sudo[85231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.info
Apr 13 17:06:44 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a29b4787-de38-4cd4-9270-f5fccc3e1372 tempest-GroupSnapshotsTest-1324007362 None] Group tempest-GroupSnapshotsTest-Group-1214692767: creating
Apr 13 17:06:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a29b4787-de38-4cd4-9270-f5fccc3e1372 tempest-GroupSnapshotsTest-1324007362 None] Group tempest-GroupSnapshotsTest-Group-1214692767: created successfully
Apr 13 17:06:45 devstack sudo[85226]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a29b4787-de38-4cd4-9270-f5fccc3e1372 tempest-GroupSnapshotsTest-1324007362 None] Create group completed successfully.
Apr 13 17:06:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:45 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:06:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3b844951-6126-44cc-a4cd-bc18ab8361d4 tempest-GroupSnapshotsTest-1324007362 None] Delete group completed successfully.
Apr 13 17:06:45 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.info" returned: 0 in 1.261s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.085s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-ced08e55-0478-4f92-82f4-21ebf6702a0e req-b18e5654-8da4-4fec-a465-1655678c71fb tempest-VolumesSnapshotsTestJSON-1618255982 None] Create snapshot completed successfully
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (68ed0b25-bcf5-499a-ac37-35b5ead4e86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f89de7b-2c4c-48cf-94be-ace79fbde0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f89de7b-2c4c-48cf-94be-ace79fbde0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117477160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=781ba897-fd00-4b59-871c-100935cd669e,host='devstack@QuobyteHD#QuobyteHD',id=ed3bb98e-9c3c-459c-929d-1a0cc3b7c422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:46Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f139e2cf-1704-4406-ad2e-a970cd269b68),volume_type_id=f139e2cf-1704-4406-ad2e-a970cd269b68)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae62b61c-9cb5-43b4-bd3b-b8f3eb2ce5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae62b61c-9cb5-43b4-bd3b-b8f3eb2ce5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79f76ff-b5e9-4cd1-8131-d36e0b036779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79f76ff-b5e9-4cd1-8131-d36e0b036779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3bb98e-9c3c-459c-929d-1a0cc3b7c422', 'volume_name': 'volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c09059-3879-4b36-b0eb-9c4c31158316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c09059-3879-4b36-b0eb-9c4c31158316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b47c40b-61db-4ec4-a643-e4a39faf6b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Volume ed3bb98e-9c3c-459c-929d-1a0cc3b7c422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422', 'volume_size': 1}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=781ba897-fd00-4b59-871c-100935cd669e,created_at=2026-04-13T15:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2117477160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=781ba897-fd00-4b59-871c-100935cd669e,host='devstack@QuobyteHD#QuobyteHD',id=ed3bb98e-9c3c-459c-929d-1a0cc3b7c422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254f6d06ddaa4264b9d8485ab508c9ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:06:46Z,use_quota=True,user_id='236f386bddb04c98be1e3bf1c0274597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f139e2cf-1704-4406-ad2e-a970cd269b68),volume_type_id=f139e2cf-1704-4406-ad2e-a970cd269b68)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Creating volume ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:06:46 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "cinder-88179dce-9a6e-4d72-a075-2137458624f8-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:46 devstack sudo[85576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 1073741824
Apr 13 17:06:46 devstack sudo[85576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-88179dce-9a6e-4d72-a075-2137458624f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "cinder-quobyte-3c056144-b86b-4f8d-beed-a06ed40bd533" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-quobyte-3c056144-b86b-4f8d-beed-a06ed40bd533" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "cinder-quobyte-88179dce-9a6e-4d72-a075-2137458624f8" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-quobyte-88179dce-9a6e-4d72-a075-2137458624f8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Deleting offline snapshot 88179dce-9a6e-4d72-a075-2137458624f8 of volume 3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] snapshot_file for this snap is: volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[38793fe3-91cb-494e-8249-064b112e90f6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:46 devstack sudo[85578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8
Apr 13 17:06:46 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:47 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8" returned: 0 in 0.993s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c056144-b86b-4f8d-beed-a06ed40bd533(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:06:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f4c4e2-0f47-4ecf-9267-968a81798d4a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:47 devstack sudo[85576]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 1073741824" returned: 0 in 1.217s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:47 devstack sudo[85588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422
Apr 13 17:06:47 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:47 devstack sudo[85587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533
Apr 13 17:06:47 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:48 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b47c40b-61db-4ec4-a643-e4a39faf6b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc66939e-0855-4014-a837-2c7accd5ca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:06:48 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Volume volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 (ed3bb98e-9c3c-459c-929d-1a0cc3b7c422): created successfully
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc66939e-0855-4014-a837-2c7accd5ca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:06:48 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Flow 'volume_create_manager' (68ed0b25-bcf5-499a-ac37-35b5ead4e86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533" returned: 0 in 0.653s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:48 devstack sudo[85597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8
Apr 13 17:06:48 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a770574b-6189-476e-89c5-89630c47e757 tempest-GroupSnapshotsTest-1324007362 None] Created volume successfully.
Apr 13 17:06:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] GroupSnapshot 5f522730-0f22-4086-902f-2c1545aa0e2c: creating.
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Group snapshot 5f522730-0f22-4086-902f-2c1545aa0e2c: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Creating offline snapshot f05f67cb-80d0-414d-9c02-614bc499fd64 of volume ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bca097b-0f82-4309-a398-b00aadde4bdd]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:49 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8" returned: 0 in 0.757s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:49 devstack sudo[85630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8
Apr 13 17:06:49 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:49 devstack sudo[85629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422
Apr 13 17:06:49 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:50 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533.88179dce-9a6e-4d72-a075-2137458624f8" returned: 0 in 1.075s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:50 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" returned: 0 in 1.170s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:50 devstack sudo[85663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 1G
Apr 13 17:06:50 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-quobyte-88179dce-9a6e-4d72-a075-2137458624f8" released by "_delete_snapshot" :: held 3.679s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-quobyte-3c056144-b86b-4f8d-beed-a06ed40bd533" released by "delete_snapshot" :: held 3.698s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:50 devstack cinder-volume[82641]: WARNING cinder.quota [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.quota [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Created reservations ['dadb498e-20b3-4f50-be10-4d061efe618b', '956faaf0-d8c5-4b38-a847-7a7dc042e1c5', '15396957-1d34-4b9d-be49-3bf59638e5d4', '10be6495-9421-4abf-9597-5d3473bc6334'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Acquiring lock "cinder-b8bd5dfd-747a-4f22-a859-61a802afa326-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "cinder-b8bd5dfd-747a-4f22-a859-61a802afa326-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Acquiring lock "cinder-quobyte-b8bd5dfd-747a-4f22-a859-61a802afa326" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "cinder-quobyte-b8bd5dfd-747a-4f22-a859-61a802afa326" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[50abdd4a-6ac6-455a-bbbd-2846f5549ae8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Delete snapshot completed successfully.
Apr 13 17:06:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-a5c6c3b6-5926-4dc1-b995-c264cfecf5b8 req-cfd3cefe-00dc-4c06-b5d0-4de528d5d743 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-88179dce-9a6e-4d72-a075-2137458624f8-delete_snapshot" released by "delete_snapshot" :: held 4.007s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:50 devstack sudo[85672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326
Apr 13 17:06:50 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:51 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 1G" returned: 0 in 0.729s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:51 devstack sudo[85677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64
Apr 13 17:06:51 devstack sudo[85677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "cinder-3c056144-b86b-4f8d-beed-a06ed40bd533-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-3c056144-b86b-4f8d-beed-a06ed40bd533-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "cinder-quobyte-3c056144-b86b-4f8d-beed-a06ed40bd533" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-quobyte-3c056144-b86b-4f8d-beed-a06ed40bd533" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e67e0eb-ad66-4272-b6fa-acc59270056d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:51 devstack sudo[85682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533
Apr 13 17:06:51 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:51 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326" returned: 0 in 1.202s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:51 devstack sudo[85690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326
Apr 13 17:06:51 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:52 devstack sudo[85677]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64" returned: 0 in 1.008s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:52 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:06:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:52 devstack sudo[85692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64
Apr 13 17:06:52 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:52 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533" returned: 0 in 1.291s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:52 devstack sudo[85710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533
Apr 13 17:06:52 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:52 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b8bd5dfd-747a-4f22-a859-61a802afa326" returned: 0 in 0.946s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "cinder-quobyte-b8bd5dfd-747a-4f22-a859-61a802afa326" released by "delete_volume" :: held 2.188s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:52 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Created reservations ['b17a8425-84e4-4fa8-93d8-5f55916bd408', '427db524-8672-49ad-83bd-03d094cba02f', '0d68e284-03a0-47df-a5cd-eec281f68886', 'b2ce8d63-c8af-4ea8-bae4-731d0f3c2418'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:53 devstack sudo[85713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:06:53 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:53 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64" returned: 0 in 1.118s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:53 devstack sudo[85715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.info
Apr 13 17:06:53 devstack sudo[85715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:53 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3c056144-b86b-4f8d-beed-a06ed40bd533" returned: 0 in 1.023s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-quobyte-3c056144-b86b-4f8d-beed-a06ed40bd533" released by "delete_volume" :: held 2.391s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.quota [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Created reservations ['24179e7d-0bdf-42f9-8ce3-5dffe10e36f0', 'a8895b2f-dd76-47f5-9ec8-76c96a6498d5', '0a0a2299-a8b0-453d-b15a-a2298231ff66', '3ef3826d-9a81-4194-9932-ec5dc60f9dc5'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:53 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.839s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:06:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Deleted volume successfully.
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b1721f2b-8a91-4c82-b850-02f7b7bf61c3 tempest-ServerRescueNegativeTestJSON-159923319 None] Lock "cinder-b8bd5dfd-747a-4f22-a859-61a802afa326-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:53 devstack sudo[85721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:06:53 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:53 devstack sudo[85715]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.info" returned: 0 in 0.774s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:53 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:06:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:53 devstack sudo[85723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.info
Apr 13 17:06:53 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:54 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.info" returned: 0 in 0.540s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.455s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:06:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-36b40a6c-a49f-4e38-a47e-72c01634d8f4 tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 5f522730-0f22-4086-902f-2c1545aa0e2c: created successfully
Apr 13 17:06:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 5f522730-0f22-4086-902f-2c1545aa0e2c: deleting
Apr 13 17:06:55 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=146,cinder:SELECT=128,cinder:INSERT=31,cinder:DELETE=5 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:06:55 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=131,cinder:UPDATE=125,cinder:INSERT=32,cinder:DELETE=7 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:06:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 5f522730-0f22-4086-902f-2c1545aa0e2c: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-f05f67cb-80d0-414d-9c02-614bc499fd64" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-f05f67cb-80d0-414d-9c02-614bc499fd64" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Deleting offline snapshot f05f67cb-80d0-414d-9c02-614bc499fd64 of volume ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:06:56 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] snapshot_file for this snap is: volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 2.218s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.manager [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[925620a0-a35b-49d9-880d-5ecf53ddae82]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Deleted volume successfully.
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-dbcf17b2-9dc0-424b-a433-07f6d067a4e3 req-bc82a085-882a-45dc-930d-c34203fdb910 tempest-VolumesSnapshotsTestJSON-1618255982 None] Lock "cinder-3c056144-b86b-4f8d-beed-a06ed40bd533-delete_volume" released by "delete_volume" :: held 5.114s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:56 devstack sudo[85818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64
Apr 13 17:06:56 devstack sudo[85818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:57 devstack sudo[85818]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64" returned: 0 in 0.988s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:06:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a609c335-7e25-4cc1-9fd7-65dac3efca5a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:57 devstack sudo[85843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422
Apr 13 17:06:57 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:57 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" returned: 0 in 0.687s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:57 devstack sudo[85850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64
Apr 13 17:06:57 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:58 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64" returned: 0 in 0.581s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:58 devstack sudo[85856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64
Apr 13 17:06:58 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:06:58 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422.f05f67cb-80d0-414d-9c02-614bc499fd64" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-f05f67cb-80d0-414d-9c02-614bc499fd64" released by "_delete_snapshot" :: held 2.991s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" released by "delete_snapshot" :: held 3.013s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:06:59 devstack cinder-volume[82641]: WARNING cinder.quota [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1086648111 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1086648111, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:06:59 devstack cinder-volume[82641]: WARNING cinder.quota [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1086648111 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1086648111, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['9252891b-7f6b-4a40-ac93-34c3a998d2f7', '3c73d819-e324-49f5-b7c6-04e7664300e2', 'ddc2d5c9-8607-4de1-9a7d-eb506d18c685', '0be05c05-7e43-4585-8c03-e1d8c49a8da5'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:06:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f5c51252-2b6f-4e9a-8c70-0d758e61a9b4 tempest-GroupSnapshotsTest-1324007362 None] group_snapshot 5f522730-0f22-4086-902f-2c1545aa0e2c: deleted successfully
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "cinder-quobyte-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb6ee28-6355-430d-b78e-4bb979b6e24f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:06:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:06:59 devstack sudo[85861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422
Apr 13 17:06:59 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:00 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:00 devstack sudo[85868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422
Apr 13 17:07:00 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0518feba-0e4e-4df7-b5f2-c3cf676d78d2 tempest-BackendsCapabilitiesAdminTestsJSON-1607920507 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.691879272461, 'free_capacity_gb': 1775.691879272461, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 17:07:00 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Lock "cinder-quobyte-ed3bb98e-9c3c-459c-929d-1a0cc3b7c422" released by "delete_volume" :: held 1.063s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['97764d4c-69de-467f-8e4b-944434bbd0ac'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:00 devstack cinder-volume[82641]: WARNING cinder.quota [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1086648111 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1086648111, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Created reservations ['f905cb27-6e49-4d69-a0c9-e7695692a055', 'cae72ae1-9ea4-4320-a2c6-e905ba2cd309', '5f53c104-f4b0-40b2-ba97-5d754c28099c', 'bac1d733-b524-4c08-a6a1-3f6747220cb7'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:00 devstack sudo[85871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:00 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-36b5c559-5cd7-4633-a6f6-b49e58407622 tempest-BackendsCapabilitiesAdminTestsJSON-1607920507 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.691879272461, 'free_capacity_gb': 1775.691879272461, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82641) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 13 17:07:01 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:01 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-40e781ca-af4e-4c19-9968-96fe499a0073 tempest-GroupSnapshotsTest-1324007362 None] Delete group completed successfully.
Apr 13 17:07:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f1a60b52-a5f4-46bd-802c-f03078e80fe0 tempest-GroupsV320Test-1385209274 None] Group tempest-GroupsV320Test-Group-1072252615: creating
Apr 13 17:07:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f1a60b52-a5f4-46bd-802c-f03078e80fe0 tempest-GroupsV320Test-1385209274 None] Group tempest-GroupsV320Test-Group-1072252615: created successfully
Apr 13 17:07:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f1a60b52-a5f4-46bd-802c-f03078e80fe0 tempest-GroupsV320Test-1385209274 None] Create group completed successfully.
Apr 13 17:07:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4a9f3617-0034-4d41-8abe-387c6c13e8a1 tempest-GroupSnapshotsV319Test-65948520 None] Group tempest-GroupSnapshotsV319Test-Group-2128871131: creating
Apr 13 17:07:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4a9f3617-0034-4d41-8abe-387c6c13e8a1 tempest-GroupSnapshotsV319Test-65948520 None] Group tempest-GroupSnapshotsV319Test-Group-2128871131: created successfully
Apr 13 17:07:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4a9f3617-0034-4d41-8abe-387c6c13e8a1 tempest-GroupSnapshotsV319Test-65948520 None] Create group completed successfully.
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Created reservations ['20a8a3e3-ffd6-418f-8fef-fb55cadf358c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Flow 'volume_create_manager' (ee5e082c-71ac-4270-92dd-d014d17515b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9455611-6bbf-401a-a477-dd104dd3242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9455611-6bbf-401a-a477-dd104dd3242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476529631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2ecf8e30-b444-43b2-8921-811c8d78af50,host='devstack@QuobyteHD#QuobyteHD',id=2a26ceff-a178-4c7b-b661-894c175a2b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c979b6d324494332bbf960b4854c5752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:09Z,use_quota=True,user_id='8302b9ef06b743c380aa98505a64ce4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9852e037-0053-45b3-a7e2-c3564df9681e),volume_type_id=9852e037-0053-45b3-a7e2-c3564df9681e)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce94ab0-9fc7-4098-92a3-268e39949346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce94ab0-9fc7-4098-92a3-268e39949346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d2fa97-43a5-45c6-9242-f6ed0985d89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d2fa97-43a5-45c6-9242-f6ed0985d89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a26ceff-a178-4c7b-b661-894c175a2b68', 'volume_name': 'volume-2a26ceff-a178-4c7b-b661-894c175a2b68', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ce11f-5d5e-4f38-b31d-c04b9e939e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ce11f-5d5e-4f38-b31d-c04b9e939e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a709d10-40ba-4811-9c48-0fccc7b6c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Volume 2a26ceff-a178-4c7b-b661-894c175a2b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a26ceff-a178-4c7b-b661-894c175a2b68', 'volume_size': 1}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2ecf8e30-b444-43b2-8921-811c8d78af50,created_at=2026-04-13T15:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476529631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2ecf8e30-b444-43b2-8921-811c8d78af50,host='devstack@QuobyteHD#QuobyteHD',id=2a26ceff-a178-4c7b-b661-894c175a2b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c979b6d324494332bbf960b4854c5752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:09Z,use_quota=True,user_id='8302b9ef06b743c380aa98505a64ce4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9852e037-0053-45b3-a7e2-c3564df9681e),volume_type_id=9852e037-0053-45b3-a7e2-c3564df9681e)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Creating volume 2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:08 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:08 devstack sudo[86013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 1073741824
Apr 13 17:07:08 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:08 devstack sudo[86015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:08 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:09 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.516s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-aedf8c4e-493e-4115-89b6-bd4462455874 tempest-GroupsV320Test-1385209274 None] Delete group completed successfully.
Apr 13 17:07:09 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 1073741824" returned: 0 in 0.685s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:09 devstack sudo[86026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68
Apr 13 17:07:09 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:10 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68" returned: 0 in 0.636s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a709d10-40ba-4811-9c48-0fccc7b6c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a26ceff-a178-4c7b-b661-894c175a2b68', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf26e60-9213-4b38-a2b4-d69c9b3e7214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Volume volume-2a26ceff-a178-4c7b-b661-894c175a2b68 (2a26ceff-a178-4c7b-b661-894c175a2b68): created successfully
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf26e60-9213-4b38-a2b4-d69c9b3e7214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Flow 'volume_create_manager' (ee5e082c-71ac-4270-92dd-d014d17515b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9957610c-4f47-4445-98cf-1a2e598b51d1 tempest-GroupSnapshotsV319Test-65948520 None] Created volume successfully.
Apr 13 17:07:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] GroupSnapshot 76c5da48-916e-448b-8370-ba6a5f875250: creating.
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Group snapshot 76c5da48-916e-448b-8370-ba6a5f875250: creating. {{(pid=82641) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Creating offline snapshot e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e of volume 2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[99513c60-be59-4b90-95d1-f7624a287e27]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:11 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68
Apr 13 17:07:11 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:11 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:11 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e 1G
Apr 13 17:07:11 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:12 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e 1G" returned: 0 in 0.722s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a26ceff-a178-4c7b-b661-894c175a2b68 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:12 devstack sudo[86050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a26ceff-a178-4c7b-b661-894c175a2b68 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e
Apr 13 17:07:12 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:12 devstack sudo[86052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:12 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:12 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a26ceff-a178-4c7b-b661-894c175a2b68 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" returned: 0 in 0.544s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:12 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:07:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:12 devstack sudo[86057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e
Apr 13 17:07:12 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:13 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.544s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:13 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:13 devstack sudo[86061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.info
Apr 13 17:07:13 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:13 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.info" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:13 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:07:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:13 devstack sudo[86064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.info
Apr 13 17:07:13 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:14 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.info" returned: 0 in 0.563s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.533s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-07a2194e-56bd-4e49-bd2b-3f39708925f4 tempest-GroupSnapshotsV319Test-65948520 None] group_snapshot 76c5da48-916e-448b-8370-ba6a5f875250: created successfully
Apr 13 17:07:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] group_snapshot 76c5da48-916e-448b-8370-ba6a5f875250: deleting
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] group_snapshot 76c5da48-916e-448b-8370-ba6a5f875250: deleting {{(pid=82641) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Acquiring lock "cinder-quobyte-2a26ceff-a178-4c7b-b661-894c175a2b68" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Lock "cinder-quobyte-2a26ceff-a178-4c7b-b661-894c175a2b68" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Acquiring lock "cinder-quobyte-e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Lock "cinder-quobyte-e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Deleting offline snapshot e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e of volume 2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] snapshot_file for this snap is: volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed90bb5-c84f-4459-8f82-aa79fd828ab3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:15 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e
Apr 13 17:07:15 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:16 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" returned: 0 in 0.757s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a26ceff-a178-4c7b-b661-894c175a2b68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a77ef0a-3f93-4cf3-bb47-7ab48e6d35d2]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:16 devstack sudo[86090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68
Apr 13 17:07:16 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:17 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68" returned: 0 in 0.568s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:17 devstack sudo[86095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e
Apr 13 17:07:17 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:17 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" returned: 0 in 0.620s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:17 devstack sudo[86100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e
Apr 13 17:07:17 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:18 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68.e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" returned: 0 in 0.540s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Lock "cinder-quobyte-e4ea1d6c-1973-4d35-bbc3-309c3db1ac0e" released by "_delete_snapshot" :: held 2.567s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Lock "cinder-quobyte-2a26ceff-a178-4c7b-b661-894c175a2b68" released by "delete_snapshot" :: held 2.581s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:18 devstack cinder-volume[82641]: WARNING cinder.quota [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2032341124 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2032341124, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:18 devstack cinder-volume[82641]: WARNING cinder.quota [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2032341124 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2032341124, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:18 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] Created reservations ['097ecdb7-abf5-4516-a35f-d5cebfacfdc6', 'bdd5e9b6-c156-4ace-891a-c3b2da99a958', 'bae30416-336a-4157-a74d-34f67b06fc35', '9fd0881d-ff8b-4d6b-956d-deae150a0b42'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ac48d9ff-44de-4dae-9649-bff2dedd579d tempest-GroupSnapshotsV319Test-65948520 None] group_snapshot 76c5da48-916e-448b-8370-ba6a5f875250: deleted successfully
Apr 13 17:07:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-902a6724-b9f2-4082-8d04-48db20074bb4 tempest-GroupsV314Test-1366525718 None] Group tempest-GroupsV314Test-Group-849469357: creating
Apr 13 17:07:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-902a6724-b9f2-4082-8d04-48db20074bb4 tempest-GroupsV314Test-1366525718 None] Group tempest-GroupsV314Test-Group-849469357: created successfully
Apr 13 17:07:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-902a6724-b9f2-4082-8d04-48db20074bb4 tempest-GroupsV314Test-1366525718 None] Create group completed successfully.
Apr 13 17:07:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Acquiring lock "cinder-quobyte-2a26ceff-a178-4c7b-b661-894c175a2b68" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Lock "cinder-quobyte-2a26ceff-a178-4c7b-b661-894c175a2b68" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0413b-b890-4fe8-a5b5-4d33ae806ad4]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:19 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68
Apr 13 17:07:19 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:19 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68" returned: 0 in 0.582s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:19 devstack sudo[86112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68
Apr 13 17:07:19 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Flow 'volume_create_manager' (8f4ae8ed-a6b0-44a2-9197-ff804300cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb35ab1-0775-44f4-bc68-ecc08b0935e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:20 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb35ab1-0775-44f4-bc68-ecc08b0935e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-553745082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=44968d5a-c4a1-4bef-8e34-c779fd4c6a12,host='devstack@QuobyteHD#QuobyteHD',id=484a2c84-1f5d-4c62-a561-da8b70127e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1613ee6c32243b99aac98587ae791c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:20Z,use_quota=True,user_id='f8bd8b021a3649769f6912a255611c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8576ea1b-9176-4f45-a7fa-378c9adf9614),volume_type_id=8576ea1b-9176-4f45-a7fa-378c9adf9614)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54de00b-de87-4f7b-af78-4ece2d5f33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54de00b-de87-4f7b-af78-4ece2d5f33d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85651fa-0bdf-4873-87d2-b646b6727f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85651fa-0bdf-4873-87d2-b646b6727f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484a2c84-1f5d-4c62-a561-da8b70127e5e', 'volume_name': 'volume-484a2c84-1f5d-4c62-a561-da8b70127e5e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2c36d0-6991-441b-a0f2-24031a783a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab2c36d0-6991-441b-a0f2-24031a783a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e20ee4-feaf-43ec-a32d-eb5f6c777ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:20 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Volume 484a2c84-1f5d-4c62-a561-da8b70127e5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484a2c84-1f5d-4c62-a561-da8b70127e5e', 'volume_size': 1}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=44968d5a-c4a1-4bef-8e34-c779fd4c6a12,created_at=2026-04-13T15:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-553745082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=44968d5a-c4a1-4bef-8e34-c779fd4c6a12,host='devstack@QuobyteHD#QuobyteHD',id=484a2c84-1f5d-4c62-a561-da8b70127e5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1613ee6c32243b99aac98587ae791c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:20Z,use_quota=True,user_id='f8bd8b021a3649769f6912a255611c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8576ea1b-9176-4f45-a7fa-378c9adf9614),volume_type_id=8576ea1b-9176-4f45-a7fa-378c9adf9614)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Creating volume 484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:20 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2a26ceff-a178-4c7b-b661-894c175a2b68" returned: 0 in 0.579s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:20 devstack sudo[86115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e 1073741824
Apr 13 17:07:20 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Lock "cinder-quobyte-2a26ceff-a178-4c7b-b661-894c175a2b68" released by "delete_volume" :: held 1.202s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Created reservations ['9378d874-55c4-41a0-855c-4e5424ba4df9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:20 devstack cinder-volume[82641]: WARNING cinder.quota [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2032341124 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2032341124, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Created reservations ['7c06f570-741c-4201-b67b-f09a9caa2adf', '1748d807-a8e9-4122-94d8-de7e83d7571f', '72f725e5-fb09-446e-9b35-12bc6affd53e', 'acf34e29-658f-4de8-b6f1-9e461e7bf244'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:20 devstack sudo[86117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:20 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:20 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e 1073741824" returned: 0 in 0.544s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:20 devstack sudo[86146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e
Apr 13 17:07:20 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:21 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.910s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-78f0f47e-0987-4eb6-b0d5-01d0a09a0ca0 tempest-GroupSnapshotsV319Test-65948520 None] Delete group completed successfully.
Apr 13 17:07:21 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e" returned: 0 in 0.802s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e20ee4-feaf-43ec-a32d-eb5f6c777ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484a2c84-1f5d-4c62-a561-da8b70127e5e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c205afb-3901-4717-912b-820096388339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Volume volume-484a2c84-1f5d-4c62-a561-da8b70127e5e (484a2c84-1f5d-4c62-a561-da8b70127e5e): created successfully
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c205afb-3901-4717-912b-820096388339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Flow 'volume_create_manager' (8f4ae8ed-a6b0-44a2-9197-ff804300cf14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8abff7fe-28d3-4fd6-ba2f-ae1f36ce0f2c tempest-GroupsV314Test-1366525718 None] Created volume successfully.
Apr 13 17:07:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:23 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Cloning volume 484a2c84-1f5d-4c62-a561-da8b70127e5e to volume 1e358660-1483-4d8d-846a-921487ffc72d
Apr 13 17:07:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Creating offline snapshot d45bcc18-369c-4397-adc7-dc96ba4530d9 of volume 484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:07:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fdc820-afa5-4061-a2ba-ebb5b2cad21e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:23 devstack sudo[86156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e
Apr 13 17:07:23 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:24 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e" returned: 0 in 0.805s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:24 devstack sudo[86161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 1G
Apr 13 17:07:24 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:25 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 1G" returned: 0 in 0.758s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-484a2c84-1f5d-4c62-a561-da8b70127e5e -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:25 devstack sudo[86166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-484a2c84-1f5d-4c62-a561-da8b70127e5e -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9
Apr 13 17:07:25 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:25 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-484a2c84-1f5d-4c62-a561-da8b70127e5e -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:25 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:25 devstack sudo[86172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9
Apr 13 17:07:25 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Flow 'volume_create_manager' (dc9b10a1-74e9-463b-a9d2-9a8916ef309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3fe88f-bb16-4025-95b6-aa8fbaea3e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc3fe88f-bb16-4025-95b6-aa8fbaea3e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-490092932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd1c08-fbea-4df8-abb9-74a08e62c929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5d21681bbc41df9fcf121a84226b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:26Z,use_quota=True,user_id='8755f87a40b5446b98bfa1a81c98f585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e855eefc-2faf-474a-9fab-ce50143c636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e855eefc-2faf-474a-9fab-ce50143c636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ea9a8a-49f4-4799-8c16-53061e20d0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ea9a8a-49f4-4799-8c16-53061e20d0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecd1c08-fbea-4df8-abb9-74a08e62c929', 'volume_name': 'volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e515e149-95a5-477c-af2d-f93f6cb0e697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e515e149-95a5-477c-af2d-f93f6cb0e697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f0e1e1-6a5c-4175-994a-dd6c6fa69075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929', 'volume_size': 1}
Apr 13 17:07:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:26 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:26 devstack sudo[86175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.info
Apr 13 17:07:26 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:26 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.info" returned: 0 in 0.499s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:26 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:07:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:26 devstack sudo[86178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.info
Apr 13 17:07:26 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:27 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.info" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Acquiring lock "cinder-quobyte-1e358660-1483-4d8d-846a-921487ffc72d" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-1e358660-1483-4d8d-846a-921487ffc72d" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] snapshot: d45bcc18-369c-4397-adc7-dc96ba4530d9, volume: 1e358660-1483-4d8d-846a-921487ffc72d,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8482eac-da30-4cba-8ddc-d20a41be8218]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:27 devstack sudo[86181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9
Apr 13 17:07:27 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:27 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484a2c84-1f5d-4c62-a561-da8b70127e5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[421d6003-8697-4005-bf05-bd1e2cf73cd6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:27 devstack sudo[86186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e
Apr 13 17:07:27 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:28 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e" returned: 0 in 0.533s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:28 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:07:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:28 devstack sudo[86195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d
Apr 13 17:07:28 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:31 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d" returned: 0 in 3.119s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c63043-e532-4bb1-a68c-a4ba6e619610]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:31 devstack sudo[86229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e
Apr 13 17:07:31 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:32 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e" returned: 0 in 0.764s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e, size 1024.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:07:32 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Converted 1024.00 MB image at 328.16 MB/s
Apr 13 17:07:32 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d is being set with open permissions: ugo+rw: NotImplementedError
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:32 devstack sudo[86234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d
Apr 13 17:07:32 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:32 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-1e358660-1483-4d8d-846a-921487ffc72d" released by "_copy_volume_from_snapshot" :: held 5.688s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Acquiring lock "cinder-quobyte-d45bcc18-369c-4397-adc7-dc96ba4530d9" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-d45bcc18-369c-4397-adc7-dc96ba4530d9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Deleting offline snapshot d45bcc18-369c-4397-adc7-dc96ba4530d9 of volume 484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] snapshot_file for this snap is: volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cf5049-31b3-4a01-b02e-a72a874efea0]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:32 devstack sudo[86237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9
Apr 13 17:07:32 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:33 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484a2c84-1f5d-4c62-a561-da8b70127e5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5ae506-95a9-4786-8e93-a1372f23e0e3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:33 devstack sudo[86242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e
Apr 13 17:07:33 devstack sudo[86242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:34 devstack sudo[86242]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e" returned: 0 in 0.569s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:34 devstack sudo[86247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9
Apr 13 17:07:34 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:34 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9" returned: 0 in 0.608s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:34 devstack sudo[86272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9
Apr 13 17:07:34 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:35 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e.d45bcc18-369c-4397-adc7-dc96ba4530d9" returned: 0 in 0.574s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-d45bcc18-369c-4397-adc7-dc96ba4530d9" released by "_delete_snapshot" :: held 2.355s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.801s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.448s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-490092932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecd1c08-fbea-4df8-abb9-74a08e62c929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5d21681bbc41df9fcf121a84226b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:26Z,use_quota=True,user_id='8755f87a40b5446b98bfa1a81c98f585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Creating volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:35 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:35 devstack sudo[86277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 1073741824
Apr 13 17:07:35 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e052e81d-f9a2-4caa-ab3f-9a0ef604e37f tempest-GroupsV314Test-1366525718 None] Create group from source-group-44968d5a-c4a1-4bef-8e34-c779fd4c6a12 completed successfully.
Apr 13 17:07:35 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 1073741824" returned: 0 in 0.627s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:35 devstack sudo[86282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929
Apr 13 17:07:35 devstack sudo[86282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Flow 'volume_create_manager' (56b06cb5-b2ac-4440-9a05-67f7f2b4a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c985e06-d11a-4ac7-9f12-79576c2e64e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c985e06-d11a-4ac7-9f12-79576c2e64e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2012137933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5825641c-b63c-4334-bcba-b8f680a43a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4455804584dd465fb1effb1d858715ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:36Z,use_quota=True,user_id='b7e67d93e87d40579f05bf3ab25a0f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ba369e-f67d-438e-b38b-1fbd32cc1510),volume_type_id=f9ba369e-f67d-438e-b38b-1fbd32cc1510)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb10b82-7844-48a9-a2b3-171a0d81520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb10b82-7844-48a9-a2b3-171a0d81520b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb043a0-5f15-48d4-aeac-59bb51c866b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb043a0-5f15-48d4-aeac-59bb51c866b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5825641c-b63c-4334-bcba-b8f680a43a1f', 'volume_name': 'volume-5825641c-b63c-4334-bcba-b8f680a43a1f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94aa4a01-26dc-4c10-9ae2-b826d4d3c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94aa4a01-26dc-4c10-9ae2-b826d4d3c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847691b6-49e3-4ac7-9098-3707d37326a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Volume 5825641c-b63c-4334-bcba-b8f680a43a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5825641c-b63c-4334-bcba-b8f680a43a1f', 'volume_size': 1}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Acquiring lock "cinder-quobyte-1e358660-1483-4d8d-846a-921487ffc72d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-1e358660-1483-4d8d-846a-921487ffc72d" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e021dd1-2d7f-4ff5-9811-5930c102c1c2]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:36 devstack sudo[86284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d
Apr 13 17:07:36 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:36 devstack sudo[86282]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.257s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2012137933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5825641c-b63c-4334-bcba-b8f680a43a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4455804584dd465fb1effb1d858715ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:36Z,use_quota=True,user_id='b7e67d93e87d40579f05bf3ab25a0f4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9ba369e-f67d-438e-b38b-1fbd32cc1510),volume_type_id=f9ba369e-f67d-438e-b38b-1fbd32cc1510)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Creating volume 5825641c-b63c-4334-bcba-b8f680a43a1f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:36 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f0e1e1-6a5c-4175-994a-dd6c6fa69075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1d979-3930-41f4-8d53-1c2984ab8103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:36 devstack sudo[86287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f 1073741824
Apr 13 17:07:36 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Volume volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 (7ecd1c08-fbea-4df8-abb9-74a08e62c929): created successfully
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec1d979-3930-41f4-8d53-1c2984ab8103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Flow 'volume_create_manager' (dc9b10a1-74e9-463b-a9d2-9a8916ef309c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-435f52d9-60a7-47f9-bb1c-e88201fb5488 tempest-SnapshotsActionsTest-72178178 None] Created volume successfully.
Apr 13 17:07:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:37 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d" returned: 0 in 0.624s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:37 devstack sudo[86294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d
Apr 13 17:07:37 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:37 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f 1073741824" returned: 0 in 0.647s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:37 devstack sudo[86297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f
Apr 13 17:07:37 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:37 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e358660-1483-4d8d-846a-921487ffc72d" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-1e358660-1483-4d8d-846a-921487ffc72d" released by "delete_volume" :: held 1.134s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Created reservations ['ce00220b-ce2d-4050-9250-ed89a0552dfb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:37 devstack cinder-volume[82641]: WARNING cinder.quota [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-881758829 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-881758829, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:37 devstack cinder-volume[82641]: WARNING cinder.quota [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-881758829 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-881758829, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Created reservations ['94caab96-b8d5-4a2a-b7c2-16dff93525be', '5a8f609b-167f-41cf-a53b-2eb9a7120cdd', '04d61bbc-eca8-4f87-a39d-ca35ac72c14b', '42dd2f08-2c27-42e1-80a8-2fa5578b04d0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:37 devstack sudo[86301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:37 devstack sudo[86301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:37 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.782s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Creating offline snapshot 4d2c15a1-2acc-4b4f-b41c-0981bad81461 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847691b6-49e3-4ac7-9098-3707d37326a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5825641c-b63c-4334-bcba-b8f680a43a1f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc30c627-000f-4032-b7ad-695f5503f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4d452b-1b03-4dd5-9d68-2c69803b6670]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Volume volume-5825641c-b63c-4334-bcba-b8f680a43a1f (5825641c-b63c-4334-bcba-b8f680a43a1f): created successfully
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc30c627-000f-4032-b7ad-695f5503f916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Flow 'volume_create_manager' (56b06cb5-b2ac-4440-9a05-67f7f2b4a31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-33e042dd-5071-4658-bc04-0dc64899f155 tempest-VolumeTypesAccessTest-2038179947 None] Created volume successfully.
Apr 13 17:07:37 devstack sudo[86303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929
Apr 13 17:07:37 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:38 devstack sudo[86301]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0b433fa9-2bea-48c1-a1db-3693b6d742df tempest-GroupsV314Test-1366525718 None] Delete group completed successfully.
Apr 13 17:07:38 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929" returned: 0 in 0.561s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:38 devstack sudo[86309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 1G
Apr 13 17:07:38 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Acquiring lock "cinder-5825641c-b63c-4334-bcba-b8f680a43a1f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Lock "cinder-5825641c-b63c-4334-bcba-b8f680a43a1f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Acquiring lock "cinder-quobyte-5825641c-b63c-4334-bcba-b8f680a43a1f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Lock "cinder-quobyte-5825641c-b63c-4334-bcba-b8f680a43a1f" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae076550-1822-46ad-bf25-b006458159be]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:38 devstack sudo[86311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f
Apr 13 17:07:38 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Acquiring lock "cinder-quobyte-484a2c84-1f5d-4c62-a561-da8b70127e5e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-484a2c84-1f5d-4c62-a561-da8b70127e5e" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[822494de-109b-4617-b1b9-f54c9f022316]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:38 devstack sudo[86318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e
Apr 13 17:07:38 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:38 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 1G" returned: 0 in 0.594s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:38 devstack sudo[86320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:07:38 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:39 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f" returned: 0 in 0.853s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:39 devstack sudo[86327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f
Apr 13 17:07:39 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:39 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e" returned: 0 in 0.810s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:39 devstack sudo[86335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e
Apr 13 17:07:39 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:39 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.661s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:39 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 is being set with open permissions: ugo+rw
Apr 13 17:07:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:39 devstack sudo[86337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:07:39 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:40 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5825641c-b63c-4334-bcba-b8f680a43a1f" returned: 0 in 0.804s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Lock "cinder-quobyte-5825641c-b63c-4334-bcba-b8f680a43a1f" released by "delete_volume" :: held 1.684s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:40 devstack cinder-volume[82641]: WARNING cinder.quota [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1123343277 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1123343277, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:40 devstack cinder-volume[82641]: WARNING cinder.quota [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1123343277 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1123343277, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Created reservations ['e4122df0-501d-4b9d-954b-fa60138dd16c', '198de8ff-1b99-436f-8ced-b343789c7da5', '027575b4-d592-448d-bdf3-b8243b745f55', '7c15e587-a108-4649-b8ae-559b15de6066'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:40 devstack sudo[86342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:40 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:40 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.873s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:40 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.info
Apr 13 17:07:40 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:40 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-484a2c84-1f5d-4c62-a561-da8b70127e5e" returned: 0 in 1.086s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Lock "cinder-quobyte-484a2c84-1f5d-4c62-a561-da8b70127e5e" released by "delete_volume" :: held 1.932s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Created reservations ['8155e928-2700-4a16-9105-d1037aa8cf17'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:40 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Created reservations ['291dc8a6-033d-48f0-8baa-4ec6c9bbc3bb', 'e8a8edc7-9a99-4728-9389-93c1687979ff', '8ec1825b-12a6-438d-b3d5-06684516702e', 'de118704-92e9-48e7-8ee2-c19f6741eb74'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:41 devstack sudo[86346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:41 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:41 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.166s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Deleted volume successfully.
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4149c644-441f-461e-932c-d40f85046763 tempest-VolumeTypesAccessTest-2038179947 None] Lock "cinder-5825641c-b63c-4334-bcba-b8f680a43a1f-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Flow 'volume_create_manager' (7c81f5e3-9190-43cb-bf8e-f6af86a0a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e82314-0646-45a8-944d-6e262c1ca028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e82314-0646-45a8-944d-6e262c1ca028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56068c80-a969-4704-89e6-06d6d3bc442f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da47858d1fcc447790d7d8581673a9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:41Z,use_quota=True,user_id='246c87d66d034b28b51d4d66a72f350f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f7edea-7621-4566-a36c-5d5a9e0e1260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f7edea-7621-4566-a36c-5d5a9e0e1260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9eddd-924f-4840-b917-0f4fcabf17bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG cinder.image.glance [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 17:07:41 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.info" returned: 0 in 1.277s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:41 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.info is being set with open permissions: ugo+rw
Apr 13 17:07:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:41 devstack sudo[86351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.info
Apr 13 17:07:41 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:42 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.110s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:42 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-900d1f3f-6f60-4e58-95d2-34d8cc1bdf30 tempest-GroupsV314Test-1366525718 None] Delete group completed successfully.
Apr 13 17:07:42 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.info" returned: 0 in 0.742s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.829s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f343a6a6-0e49-4b75-993b-3c15270a3123 tempest-SnapshotsActionsTest-72178178 None] Create snapshot completed successfully
Apr 13 17:07:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a9eddd-924f-4840-b917-0f4fcabf17bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56068c80-a969-4704-89e6-06d6d3bc442f', 'volume_name': 'volume-56068c80-a969-4704-89e6-06d6d3bc442f', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd2ad7bb0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f288d9d-ee9c-47a2-b3ce-e732b5f8e648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f288d9d-ee9c-47a2-b3ce-e732b5f8e648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6762329a-1a8b-4bbf-ad1d-fc482b1a74b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Volume 56068c80-a969-4704-89e6-06d6d3bc442f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56068c80-a969-4704-89e6-06d6d3bc442f', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd2ad7bb0>}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Trying to clone 56068c80-a969-4704-89e6-06d6d3bc442f from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 17:07:43 devstack cinder-volume[82641]: INFO cinder.image.image_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fce3f2-2705-4454-af50-8d118c321016]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:43 devstack sudo[86379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD
Apr 13 17:07:43 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Creating offline snapshot 60cf3042-66f3-4eb9-b24b-fef083633467 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b495b9-66a7-4ece-aef1-2d93a04b9bcb]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:44 devstack sudo[86385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:07:44 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:44 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD" returned: 0 in 1.303s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:44 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 is fetched for user 246c87d66d034b28b51d4d66a72f350f. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 17:07:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d403b-d4bc-45d2-8213-fe9aaf867c91]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:44 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.931s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:44 devstack sudo[86441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD
Apr 13 17:07:44 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:44 devstack sudo[86446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 1G
Apr 13 17:07:44 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:45 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:45 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 1G" returned: 0 in 0.923s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:45 devstack sudo[86455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467
Apr 13 17:07:45 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:46 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467" returned: 0 in 0.714s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:46 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 is being set with open permissions: ugo+rw
Apr 13 17:07:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:46 devstack sudo[86460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467
Apr 13 17:07:46 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:47 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56068c80-a969-4704-89e6-06d6d3bc442f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da47858d1fcc447790d7d8581673a9b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:41Z,use_quota=True,user_id='246c87d66d034b28b51d4d66a72f350f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Creating volume 56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:47 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:47 devstack sudo[86463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f 1073741824
Apr 13 17:07:47 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5f53c1f5-2594-4198-96e9-413a16d8e4f9 tempest-SnapshotsActionsTest-72178178 None] Create snapshot completed successfully
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Flow 'volume_create_manager' (ab9e700c-8def-4cc4-98ea-1d95392320d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6205cb35-f695-4715-b5f9-84744c8c61b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6205cb35-f695-4715-b5f9-84744c8c61b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-751947886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee1a822-2178-4035-9d92-8413d04a8fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd42592524a048168e62316a2c37f551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:47Z,use_quota=True,user_id='30163ef49706465e85cece7b7ca67e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44c2bca6-6216-4a29-8813-14df380bef90),volume_type_id=44c2bca6-6216-4a29-8813-14df380bef90)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f0b0a-f326-45e4-85a4-1f411bb1495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8f0b0a-f326-45e4-85a4-1f411bb1495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df631fa5-bdb3-4954-b6da-8529767f179a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df631fa5-bdb3-4954-b6da-8529767f179a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee1a822-2178-4035-9d92-8413d04a8fb7', 'volume_name': 'volume-cee1a822-2178-4035-9d92-8413d04a8fb7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3537ff5-adf8-46ac-937e-0cd53b3d5f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3537ff5-adf8-46ac-937e-0cd53b3d5f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7ee52b-1356-4be3-9c14-f32ceed6afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Volume cee1a822-2178-4035-9d92-8413d04a8fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee1a822-2178-4035-9d92-8413d04a8fb7', 'volume_size': 1}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:47 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f 1073741824" returned: 0 in 0.670s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:47 devstack sudo[86468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:07:47 devstack sudo[86468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:48 devstack sudo[86468]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-751947886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee1a822-2178-4035-9d92-8413d04a8fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd42592524a048168e62316a2c37f551',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:47Z,use_quota=True,user_id='30163ef49706465e85cece7b7ca67e54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44c2bca6-6216-4a29-8813-14df380bef90),volume_type_id=44c2bca6-6216-4a29-8813-14df380bef90)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Creating volume cee1a822-2178-4035-9d92-8413d04a8fb7 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:48 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-60cf3042-66f3-4eb9-b24b-fef083633467-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:48 devstack sudo[86471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7 1073741824
Apr 13 17:07:48 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Attempting download of 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume 56068c80-a969-4704-89e6-06d6d3bc442f. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-60cf3042-66f3-4eb9-b24b-fef083633467-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-60cf3042-66f3-4eb9-b24b-fef083633467" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-60cf3042-66f3-4eb9-b24b-fef083633467" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Deleting offline snapshot 60cf3042-66f3-4eb9-b24b-fef083633467 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] snapshot_file for this snap is: volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3bda0-a620-4218-a5a9-a5e5c87f671a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[470ff760-ddfc-43d2-89f7-d35c7dfa3582]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_tnuol10t {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:48 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467
Apr 13 17:07:48 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:48 devstack sudo[86475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_tnuol10t
Apr 13 17:07:48 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:49 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467" returned: 0 in 0.818s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e03c67-b84c-437c-8eff-34918e1d5f8d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:49 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7 1073741824" returned: 0 in 0.986s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:49 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_tnuol10t" returned: 0 in 0.858s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_tnuol10t {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:49 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:07:49 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:49 devstack sudo[86490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7
Apr 13 17:07:49 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:49 devstack sudo[86489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_tnuol10t
Apr 13 17:07:49 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:49 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7ee52b-1356-4be3-9c14-f32ceed6afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee1a822-2178-4035-9d92-8413d04a8fb7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14e6498-0582-4e36-adcb-2cc53f4ab210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:49 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Volume volume-cee1a822-2178-4035-9d92-8413d04a8fb7 (cee1a822-2178-4035-9d92-8413d04a8fb7): created successfully
Apr 13 17:07:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14e6498-0582-4e36-adcb-2cc53f4ab210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Flow 'volume_create_manager' (ab9e700c-8def-4cc4-98ea-1d95392320d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a9dcd165-44df-4df9-8966-f8d58317a124 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Created volume successfully.
Apr 13 17:07:50 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.791s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:50 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_tnuol10t" returned: 1 in 0.755s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_tnuol10t' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[54763c64-23d3-44de-b5bf-a02c5cdd0ecd]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:50 devstack sudo[86500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467
Apr 13 17:07:50 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:50 devstack sudo[86502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD
Apr 13 17:07:50 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:50 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:50 devstack sudo[86516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:07:50 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:50 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467" returned: 0 in 0.831s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:50 devstack sudo[86518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467
Apr 13 17:07:50 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:51 devstack sudo[86520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:51 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:51 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.60cf3042-66f3-4eb9-b24b-fef083633467" returned: 0 in 0.800s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-60cf3042-66f3-4eb9-b24b-fef083633467" released by "_delete_snapshot" :: held 3.303s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" released by "delete_snapshot" :: held 3.320s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:51 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.649s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-401ac33a-5526-403e-857a-d7dcd8bf83c2 tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Retype volume completed successfully.
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Created reservations ['4db68123-4fc8-4596-a9bc-c8acd8743f88', 'f5fe9805-242e-4322-9d5d-340c50f54360', '520d9a79-1905-4b47-a7b8-2d1718fcc6ef', '676ef35e-9381-45f1-9ea8-8bb0923d4028'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Delete snapshot completed successfully.
Apr 13 17:07:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-67d2b871-de6b-44c6-b7fe-5daf6572e84d tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-60cf3042-66f3-4eb9-b24b-fef083633467-delete_snapshot" released by "delete_snapshot" :: held 3.519s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:52 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 0 in 1.382s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_f_ad5x2vdevstack@QuobyteHD, size 112.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:07:52 devstack cinder-volume[82641]: INFO cinder.image.image_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Converted 112.00 MB image at 80.99 MB/s
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:52 devstack sudo[86531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f 1G
Apr 13 17:07:52 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Acquiring lock "cinder-cee1a822-2178-4035-9d92-8413d04a8fb7-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "cinder-cee1a822-2178-4035-9d92-8413d04a8fb7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Acquiring lock "cinder-quobyte-cee1a822-2178-4035-9d92-8413d04a8fb7" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "cinder-quobyte-cee1a822-2178-4035-9d92-8413d04a8fb7" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dce22b0-2063-4336-a323-e71520bda6f5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:52 devstack sudo[86533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7
Apr 13 17:07:52 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Creating offline snapshot b0e8e7fd-070b-4226-a1b3-feb2c747b3ff of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[994f6dfa-7f70-4235-beda-698e01486671]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:52 devstack sudo[86538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:07:52 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:53 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f 1G" returned: 0 in 0.830s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9ff789-7053-4f4f-89c3-68fd18f88a59]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:53 devstack sudo[86543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:07:53 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:53 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7" returned: 0 in 0.840s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:53 devstack sudo[86545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7
Apr 13 17:07:53 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:53 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.746s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:53 devstack sudo[86550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff 1G
Apr 13 17:07:53 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:53 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 0 in 0.759s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:53 devstack sudo[86554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:07:53 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:53 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cee1a822-2178-4035-9d92-8413d04a8fb7" returned: 0 in 0.721s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "cinder-quobyte-cee1a822-2178-4035-9d92-8413d04a8fb7" released by "delete_volume" :: held 1.592s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:54 devstack cinder-volume[82641]: WARNING cinder.quota [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:54 devstack cinder-volume[82641]: WARNING cinder.quota [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Created reservations ['122b0b8f-ca6a-454c-9bf0-028342e605e3', '1ba51bbf-a86b-4c6a-abe0-d84a3829e91e', '1a488e60-6463-4a3b-baea-ed1564fec068', '39fc765d-ca93-4674-986c-32fbb69c90fe'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:54 devstack sudo[86560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:07:54 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:54 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff 1G" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:54 devstack sudo[86562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff
Apr 13 17:07:54 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:54 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 1 in 0.756s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Downloaded image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume 56068c80-a969-4704-89e6-06d6d3bc442f successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 for user 246c87d66d034b28b51d4d66a72f350f is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Marking volume 56068c80-a969-4704-89e6-06d6d3bc442f as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Copying metadata from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 to 56068c80-a969-4704-89e6-06d6d3bc442f. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Creating volume glance metadata for volume 56068c80-a969-4704-89e6-06d6d3bc442f backed by image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6762329a-1a8b-4bbf-ad1d-fc482b1a74b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56068c80-a969-4704-89e6-06d6d3bc442f', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd2ad7bb0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb08072-7915-4141-a323-f42dcb2de756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Volume volume-56068c80-a969-4704-89e6-06d6d3bc442f (56068c80-a969-4704-89e6-06d6d3bc442f): created successfully
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb08072-7915-4141-a323-f42dcb2de756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Flow 'volume_create_manager' (7c81f5e3-9190-43cb-bf8e-f6af86a0a330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-a444c959-5937-47e7-9ea2-9cac237db811 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Created volume successfully.
Apr 13 17:07:54 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" returned: 0 in 0.575s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:54 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff is being set with open permissions: ugo+rw
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:54 devstack sudo[86571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff
Apr 13 17:07:54 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:54 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.812s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:07:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Deleted volume successfully.
Apr 13 17:07:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bc9a81c3-dd54-4e4c-8b88-f0e98fb80d0b tempest-VolumeRetypeWithoutMigrationTest-283755277 None] Lock "cinder-cee1a822-2178-4035-9d92-8413d04a8fb7-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:55 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.570s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-23ff543f-c688-4013-b83a-f77fb8ffee8d tempest-SnapshotsActionsTest-72178178 None] Create snapshot completed successfully
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-b0e8e7fd-070b-4226-a1b3-feb2c747b3ff-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-b0e8e7fd-070b-4226-a1b3-feb2c747b3ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Deleting offline snapshot b0e8e7fd-070b-4226-a1b3-feb2c747b3ff of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] snapshot_file for this snap is: volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb98155-040e-44c1-acd2-a6fe6a1fe6a5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:56 devstack sudo[86608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff
Apr 13 17:07:56 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:56 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" returned: 0 in 0.668s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddf2038-fd90-49c8-9014-3d5ba718d9ad]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:56 devstack sudo[86613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:07:56 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=117,cinder:DELETE=7,cinder:INSERT=29,cinder:UPDATE=107 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=125,cinder:SELECT=128,cinder:INSERT=35,cinder:DELETE=5 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (400e39d3-aa76-4eb1-836e-7475d688d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cec123-f6da-4c2d-96cd-9fdd5fce2eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53cec123-f6da-4c2d-96cd-9fdd5fce2eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1824878103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0097a7cc-8653-4aaf-baff-2192ab7d4d9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:57Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d67ed4e-358c-403e-849d-b0ea512d19df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d67ed4e-358c-403e-849d-b0ea512d19df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761224a2-2510-45c2-ad82-f570355ab12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761224a2-2510-45c2-ad82-f570355ab12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0097a7cc-8653-4aaf-baff-2192ab7d4d9d', 'volume_name': 'volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d459caa6-3a47-4f9e-ae7d-245224f67ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d459caa6-3a47-4f9e-ae7d-245224f67ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffef797-544a-4a06-a47f-147912a15c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:57 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Volume 0097a7cc-8653-4aaf-baff-2192ab7d4d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d', 'volume_size': 1}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1824878103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0097a7cc-8653-4aaf-baff-2192ab7d4d9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:57Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Creating volume 0097a7cc-8653-4aaf-baff-2192ab7d4d9d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:57 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:57 devstack sudo[86615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d 1073741824
Apr 13 17:07:57 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:57 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.719s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:57 devstack sudo[86628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff
Apr 13 17:07:57 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:57 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d 1073741824" returned: 0 in 0.612s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:57 devstack sudo[86633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d
Apr 13 17:07:57 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:58 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" returned: 0 in 0.588s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:58 devstack sudo[86638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff
Apr 13 17:07:58 devstack sudo[86638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:58 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.807s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffef797-544a-4a06-a47f-147912a15c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1579dc3b-b930-49fe-9b31-e2248ade76a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Volume volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d (0097a7cc-8653-4aaf-baff-2192ab7d4d9d): created successfully
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1579dc3b-b930-49fe-9b31-e2248ade76a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (400e39d3-aa76-4eb1-836e-7475d688d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f4dd02-0dd4-46e5-b969-0480a84a1842]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-79f79606-9ea8-4d25-af02-5f18acc5c4bb tempest-VolumesGetTest-19600692 None] Created volume successfully.
Apr 13 17:07:58 devstack sudo[86641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:07:58 devstack sudo[86641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:58 devstack sudo[86638]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" returned: 0 in 0.608s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Flow 'volume_create_manager' (574685d7-d191-491f-89d3-2c8ed6d8b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a0bb7a-e7a1-4f7e-86ac-2ab452a5e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-b0e8e7fd-070b-4226-a1b3-feb2c747b3ff" released by "_delete_snapshot" :: held 2.675s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a0bb7a-e7a1-4f7e-86ac-2ab452a5e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-267834600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea41033-cf9a-40e7-b1e3-7a4777f98043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922d36236dd046959f911d82d1da4ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:59Z,use_quota=True,user_id='d34dd1c796f44b0388786cddab15408c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21590ea4-6e90-4082-bede-82f818d60af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21590ea4-6e90-4082-bede-82f818d60af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f41032-bb0e-4396-a347-4366327101e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f41032-bb0e-4396-a347-4366327101e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea41033-cf9a-40e7-b1e3-7a4777f98043', 'volume_name': 'volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad957086-3649-4705-8e66-e4a1a67e74d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad957086-3649-4705-8e66-e4a1a67e74d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7af61a-fa92-419c-8c4c-c3419d9b8806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Volume 1ea41033-cf9a-40e7-b1e3-7a4777f98043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043', 'volume_size': 1}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" released by "delete_snapshot" :: held 2.720s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Created reservations ['13ba6a08-d624-4eac-99e2-925288e8323a', '5650f1b9-951c-4e6e-ac55-918ef51ffb7b', '7afee071-b28f-4d0b-a763-92b3dd790c76', '25d8b4d0-3a3c-4c61-8a0c-3a97a7594641'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:07:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Delete snapshot completed successfully.
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4eab4cf6-b071-41b2-b323-85b7416a8bfc tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-b0e8e7fd-070b-4226-a1b3-feb2c747b3ff-delete_snapshot" released by "delete_snapshot" :: held 2.802s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:07:58 devstack sudo[86641]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 0 in 0.598s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:58 devstack sudo[86646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:07:58 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:59 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 1 in 0.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.182s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-267834600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea41033-cf9a-40e7-b1e3-7a4777f98043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922d36236dd046959f911d82d1da4ce6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:07:59Z,use_quota=True,user_id='d34dd1c796f44b0388786cddab15408c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Creating volume 1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:07:59 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:07:59 devstack sudo[86652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 1073741824
Apr 13 17:07:59 devstack sudo[86652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5', 'name': 'volume-56068c80-a969-4704-89e6-06d6d3bc442f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08acab1f-3301-4458-a988-7b1dd70109eb', 'enforce_multipath': True} {{(pid=82641) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 13 17:07:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-bcdd1176-a01e-4302-a2d9-89949794555f req-0c4b27bc-22e6-4ea2-ac8a-616aacf569ad tempest-ServerBootFromVolumeStableRescueTest-505035589 None] attachment_update completed successfully.
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (d602857f-ec28-4a2c-b252-ef9fdc206a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df261413-e856-451d-88ff-9803731476d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df261413-e856-451d-88ff-9803731476d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-527461673',display_name='tempest-VolumesGetTest-Volume-878479943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4f8840-ebd5-4a24-adbd-0bf2a6af4a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:00Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4198dda7-a8e8-4d3f-959f-e3244cc261d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4198dda7-a8e8-4d3f-959f-e3244cc261d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52b2da9-44df-46ce-8330-9c7d945a682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52b2da9-44df-46ce-8330-9c7d945a682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4f8840-ebd5-4a24-adbd-0bf2a6af4a57', 'volume_name': 'volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45743fc-763e-4a6f-98db-f59e221139ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45743fc-763e-4a6f-98db-f59e221139ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b160f9-826c-45ae-8877-b4d39560bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:07:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Volume af4f8840-ebd5-4a24-adbd-0bf2a6af4a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57', 'volume_size': 1}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:07:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:00 devstack sudo[86652]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 1073741824" returned: 0 in 0.734s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:00 devstack sudo[86657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043
Apr 13 17:08:00 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:00 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-527461673',display_name='tempest-VolumesGetTest-Volume-878479943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4f8840-ebd5-4a24-adbd-0bf2a6af4a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:00Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Creating volume af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:00 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:00 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 1073741824
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7af61a-fa92-419c-8c4c-c3419d9b8806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:00 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a5d3c-78c8-48a5-9e51-975df8d31f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Volume volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 (1ea41033-cf9a-40e7-b1e3-7a4777f98043): created successfully
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557a5d3c-78c8-48a5-9e51-975df8d31f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Flow 'volume_create_manager' (574685d7-d191-491f-89d3-2c8ed6d8b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-88c17724-9b87-48d9-bbe8-842c8fd86e0f tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Created volume successfully.
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:01 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 1073741824" returned: 0 in 0.571s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:01 devstack sudo[86665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57
Apr 13 17:08:01 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:01 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.803s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b160f9-826c-45ae-8877-b4d39560bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e366b1b-6356-453f-9117-1ce8a63410ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Creating offline snapshot 5de24f11-3c4b-4529-9a40-e71b66591971 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[302484e9-30b8-49ca-b158-022b398c7a99]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Volume volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 (af4f8840-ebd5-4a24-adbd-0bf2a6af4a57): created successfully
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e366b1b-6356-453f-9117-1ce8a63410ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (d602857f-ec28-4a2c-b252-ef9fdc206a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-42057a13-ca42-4a4d-99a5-ed6662d417a3 tempest-VolumesGetTest-19600692 None] Created volume successfully.
Apr 13 17:08:01 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:08:01 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:02 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:02 devstack sudo[86673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 1G
Apr 13 17:08:02 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:02 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 1G" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:02 devstack sudo[86681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971
Apr 13 17:08:02 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Lock "cinder-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5d674e-fbd3-4774-999c-c2b468691514]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:03 devstack sudo[86684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57
Apr 13 17:08:03 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:03 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:03 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 is being set with open permissions: ugo+rw
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:03 devstack sudo[86688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971
Apr 13 17:08:03 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:03 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57" returned: 0 in 0.545s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:03 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:03 devstack sudo[86694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57
Apr 13 17:08:03 devstack sudo[86694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.596s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Creating offline snapshot 71b836e2-c312-4c0a-b7e9-23935e665140 of volume 1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d02af68-7cf8-480b-9f68-0b0d8f745f27]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c503eb75-e4f3-4068-9dc5-175f09bb663b tempest-SnapshotsActionsTest-72178178 None] Create snapshot completed successfully
Apr 13 17:08:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:03 devstack sudo[86696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043
Apr 13 17:08:03 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-5de24f11-3c4b-4529-9a40-e71b66591971-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-5de24f11-3c4b-4529-9a40-e71b66591971-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-5de24f11-3c4b-4529-9a40-e71b66591971" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-5de24f11-3c4b-4529-9a40-e71b66591971" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Deleting offline snapshot 5de24f11-3c4b-4529-9a40-e71b66591971 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] snapshot_file for this snap is: volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cd5eeb-6331-4b5d-9115-8933dea4193f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:04 devstack sudo[86694]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57" returned: 0 in 0.618s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57" released by "delete_volume" :: held 1.189s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:04 devstack sudo[86721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971
Apr 13 17:08:04 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Created reservations ['b138a810-2593-4c12-8a11-fedf67177bbf', 'abd2826e-31bd-4e11-ab08-01dbe20789c7', '8efe18d0-799b-4445-a805-801cba2cce36', '642feb71-9053-4d97-9173-846744db4a32'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:04 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043" returned: 0 in 0.692s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:04 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 1G
Apr 13 17:08:04 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:04 devstack sudo[86729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:04 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:05 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971" returned: 0 in 0.738s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2012efab-dcff-4897-9002-cdcd84ff9f17]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:05 devstack sudo[86738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:08:05 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:05 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.678s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Deleted volume successfully.
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c7999200-2022-4274-80f2-e59e9d69994f tempest-VolumesGetTest-19600692 None] Lock "cinder-af4f8840-ebd5-4a24-adbd-0bf2a6af4a57-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-0097a7cc-8653-4aaf-baff-2192ab7d4d9d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Lock "cinder-0097a7cc-8653-4aaf-baff-2192ab7d4d9d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-0097a7cc-8653-4aaf-baff-2192ab7d4d9d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-0097a7cc-8653-4aaf-baff-2192ab7d4d9d" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b30b77-9f2c-4b4d-b421-f9dbad7af582]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:05 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 1G" returned: 0 in 1.035s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:05 devstack sudo[86745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140
Apr 13 17:08:05 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:05 devstack sudo[86744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d
Apr 13 17:08:05 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:05 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.588s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:05 devstack sudo[86751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971
Apr 13 17:08:05 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:06 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140" returned: 0 in 0.491s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:06 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 is being set with open permissions: ugo+rw
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:06 devstack sudo[86759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140
Apr 13 17:08:06 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:06 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d" returned: 0 in 0.600s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:06 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d
Apr 13 17:08:06 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:06 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971" returned: 0 in 0.742s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:06 devstack sudo[86766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971
Apr 13 17:08:06 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:06 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140" returned: 0 in 0.756s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:06 devstack sudo[86770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.info
Apr 13 17:08:06 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:06 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0097a7cc-8653-4aaf-baff-2192ab7d4d9d" returned: 0 in 0.856s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-0097a7cc-8653-4aaf-baff-2192ab7d4d9d" released by "delete_volume" :: held 1.484s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:06 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Created reservations ['e325fd11-ba39-4d43-abf8-446a03f183e7', 'bfe93eeb-1645-40f3-bad6-78a79ada5ad6', 'a6c0ca2b-f29e-455a-b96f-25aab280aa7d', '2d3eb693-be05-4eb3-9912-59c78baea2ba'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:07 devstack sudo[86774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:07 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:07 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5de24f11-3c4b-4529-9a40-e71b66591971" returned: 0 in 0.733s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-5de24f11-3c4b-4529-9a40-e71b66591971" released by "_delete_snapshot" :: held 2.884s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" released by "delete_snapshot" :: held 2.920s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Created reservations ['790d08ee-261b-4fb1-ae71-1ff69707cae3', '29ab4f66-aea0-4e1e-8f1a-7ccab358a55c', '86498701-9d56-4df8-aea7-36f63ce8eb6b', '9a4930ef-4bb1-4c64-8241-78cf7adf0f67'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Delete snapshot completed successfully.
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4ed5a32d-af39-4789-a2a2-3d8dfe1cafda tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-5de24f11-3c4b-4529-9a40-e71b66591971-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:07 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.info" returned: 0 in 0.741s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:07 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.info is being set with open permissions: ugo+rw
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:07 devstack sudo[86778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.info
Apr 13 17:08:07 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:07 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.716s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Deleted volume successfully.
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-910e0cad-e49c-4cda-9674-f49d10597b7b tempest-VolumesGetTest-19600692 None] Lock "cinder-0097a7cc-8653-4aaf-baff-2192ab7d4d9d-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (af6d3e35-8444-4b9f-a053-f1a3878efa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa254d8-0673-46dd-b6d7-807dbf3b1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa254d8-0673-46dd-b6d7-807dbf3b1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1894985818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81361cf0-9a39-4a21-91be-2152294a5889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:08Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fc1366-a429-473d-9707-a803bc7fe1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00fc1366-a429-473d-9707-a803bc7fe1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee12360-0628-4b91-a077-8c36ae954bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee12360-0628-4b91-a077-8c36ae954bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81361cf0-9a39-4a21-91be-2152294a5889', 'volume_name': 'volume-81361cf0-9a39-4a21-91be-2152294a5889', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56209e16-94ad-40b4-8b37-45f1fdf2cd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56209e16-94ad-40b4-8b37-45f1fdf2cd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c6d0c5-4491-452e-b817-4fe5279a2e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Volume 81361cf0-9a39-4a21-91be-2152294a5889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81361cf0-9a39-4a21-91be-2152294a5889', 'volume_size': 1}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:08 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.info" returned: 0 in 0.799s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.594s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8fe60855-facb-4a77-9f65-442b7e9460cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Create snapshot completed successfully
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Creating offline snapshot 5b915b8e-18f1-428c-b120-4474bacd3838 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcf18dc-3bd2-487a-bef6-ac086223f7a5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:08 devstack sudo[86782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:08:08 devstack sudo[86782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "cinder-71b836e2-c312-4c0a-b7e9-23935e665140-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-71b836e2-c312-4c0a-b7e9-23935e665140-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "cinder-quobyte-1ea41033-cf9a-40e7-b1e3-7a4777f98043" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-quobyte-1ea41033-cf9a-40e7-b1e3-7a4777f98043" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "cinder-quobyte-71b836e2-c312-4c0a-b7e9-23935e665140" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-quobyte-71b836e2-c312-4c0a-b7e9-23935e665140" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Deleting offline snapshot 71b836e2-c312-4c0a-b7e9-23935e665140 of volume 1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] snapshot_file for this snap is: volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[544375b9-118c-42d9-9e15-fe7e08baf740]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:09 devstack sudo[86787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140
Apr 13 17:08:09 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:09 devstack sudo[86782]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.653s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:09 devstack sudo[86790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 1G
Apr 13 17:08:09 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:09 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[997cb540-6cac-475f-8ba5-cc102ee9ccfd]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:09 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043
Apr 13 17:08:09 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:09 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 1G" returned: 0 in 0.623s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:09 devstack sudo[86807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838
Apr 13 17:08:09 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:10 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:10 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140
Apr 13 17:08:10 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:10 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:10 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 is being set with open permissions: ugo+rw
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:10 devstack sudo[86823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838
Apr 13 17:08:10 devstack sudo[86823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:10 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:10 devstack sudo[86828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140
Apr 13 17:08:10 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:10 devstack sudo[86823]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.519s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1894985818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81361cf0-9a39-4a21-91be-2152294a5889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:08Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Creating volume 81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:10 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:10 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 1073741824
Apr 13 17:08:10 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-04873917-b73e-4354-be1e-c4ca26dba300 tempest-SnapshotsActionsTest-72178178 None] Create snapshot completed successfully
Apr 13 17:08:11 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043.71b836e2-c312-4c0a-b7e9-23935e665140" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-quobyte-71b836e2-c312-4c0a-b7e9-23935e665140" released by "_delete_snapshot" :: held 2.234s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-quobyte-1ea41033-cf9a-40e7-b1e3-7a4777f98043" released by "delete_snapshot" :: held 2.254s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-5b915b8e-18f1-428c-b120-4474bacd3838-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-5b915b8e-18f1-428c-b120-4474bacd3838-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Acquiring lock "cinder-quobyte-5b915b8e-18f1-428c-b120-4474bacd3838" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-5b915b8e-18f1-428c-b120-4474bacd3838" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Deleting offline snapshot 5b915b8e-18f1-428c-b120-4474bacd3838 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] snapshot_file for this snap is: volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Created reservations ['a7a1b31a-ef19-4744-a8ec-ad4a85fec55c', '58d37f32-56cc-4e69-8f26-4811a9001806', '6ff2ba7f-b7c9-41db-b53e-e671972ca7b1', '6dd79be8-e54e-4b53-802d-937d9b08a4eb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1764aa8-3847-4c74-9db1-3399d7c0b7d7]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Delete snapshot completed successfully.
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-28ed3135-5c52-41ea-8241-e31d86253b5d tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-71b836e2-c312-4c0a-b7e9-23935e665140-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:11 devstack sudo[86862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838
Apr 13 17:08:11 devstack sudo[86862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:11 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 1073741824" returned: 0 in 0.770s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:11 devstack sudo[86865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889
Apr 13 17:08:11 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:11 devstack sudo[86862]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838" returned: 0 in 0.610s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1c7e8c-b39e-489a-830f-84953c9c0db2]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:11 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c6d0c5-4491-452e-b817-4fe5279a2e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81361cf0-9a39-4a21-91be-2152294a5889', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac0574b-7e6b-4e5e-9bc6-c79c444f36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Volume volume-81361cf0-9a39-4a21-91be-2152294a5889 (81361cf0-9a39-4a21-91be-2152294a5889): created successfully
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac0574b-7e6b-4e5e-9bc6-c79c444f36e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:12 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:08:12 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (af6d3e35-8444-4b9f-a053-f1a3878efa82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a045e0ad-fd47-49d0-9e8c-9044aa99c69e tempest-VolumesGetTest-19600692 None] Created volume successfully.
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "cinder-1ea41033-cf9a-40e7-b1e3-7a4777f98043-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-1ea41033-cf9a-40e7-b1e3-7a4777f98043-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "cinder-quobyte-1ea41033-cf9a-40e7-b1e3-7a4777f98043" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-quobyte-1ea41033-cf9a-40e7-b1e3-7a4777f98043" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6792844f-bd1f-4a23-9d2d-20d29f6b5abe]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:12 devstack sudo[86873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043
Apr 13 17:08:12 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:12 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:12 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838
Apr 13 17:08:12 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:12 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:12 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (a38272f1-ba1e-4246-8511-b55477da37d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ed20e7-709f-42fe-8bdb-aa58f178503c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ed20e7-709f-42fe-8bdb-aa58f178503c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-16914784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b86e75f-f1ac-4275-ae2e-b2deabe33d56,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=81361cf0-9a39-4a21-91be-2152294a5889,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:13Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f7bdfe-2aab-47f3-8c0c-17e64c6cd418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f7bdfe-2aab-47f3-8c0c-17e64c6cd418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ef2af7-d274-4dae-a8aa-00a5cb33b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ef2af7-d274-4dae-a8aa-00a5cb33b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0b86e75f-f1ac-4275-ae2e-b2deabe33d56', 'volume_name': 'volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56', 'volume_size': 1, 'source_volid': '81361cf0-9a39-4a21-91be-2152294a5889', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f3e57f-ef94-42b9-a4ac-5d211422dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:12 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84f3e57f-ef94-42b9-a4ac-5d211422dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23042a7d-8399-4624-9857-296622993da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Volume 0b86e75f-f1ac-4275-ae2e-b2deabe33d56: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56', 'volume_size': 1, 'source_volid': '81361cf0-9a39-4a21-91be-2152294a5889', 'source_volstatus': 'available'}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043" returned: 0 in 0.650s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:12 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Cloning volume 81361cf0-9a39-4a21-91be-2152294a5889 to volume 0b86e75f-f1ac-4275-ae2e-b2deabe33d56
Apr 13 17:08:12 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Creating offline snapshot 341e0192-c3e1-47c6-96a2-1519051470bf of volume 81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:08:12 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fa4de7-2e49-4f7c-8f32-1b3cf7141c74]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:12 devstack sudo[86888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889
Apr 13 17:08:12 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:13 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838" returned: 0 in 0.753s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:13 devstack sudo[86904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838
Apr 13 17:08:13 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:13 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.756s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:13 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1ea41033-cf9a-40e7-b1e3-7a4777f98043" returned: 0 in 0.678s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:13 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-quobyte-1ea41033-cf9a-40e7-b1e3-7a4777f98043" released by "delete_volume" :: held 1.355s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889" returned: 0 in 0.628s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:13 devstack sudo[86917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf 1G
Apr 13 17:08:13 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Created reservations ['28b20196-0c3d-44cc-ba9e-968249bfb176', 'b729e489-6eae-44ed-a9d9-24f9d0074d22', 'cb5110a7-3d2c-487b-9908-d9accf0f5f46', '77f5df37-f24b-402c-b792-93347fcdc6b2'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:13 devstack sudo[86919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:13 devstack sudo[86919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:13 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.5b915b8e-18f1-428c-b120-4474bacd3838" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-5b915b8e-18f1-428c-b120-4474bacd3838" released by "_delete_snapshot" :: held 2.477s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" released by "delete_snapshot" :: held 2.502s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Created reservations ['d1850814-ac55-453a-bc80-541513d4af6e', '441b0d59-52da-4437-b3f0-58efecf55a83', '2c2cb1e6-dcdf-4d0b-b131-ed08634dc851', 'eec981a5-dbcc-42e1-b2d6-fea5e386fa15'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Delete snapshot completed successfully.
Apr 13 17:08:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-60f2428f-4c4e-4b1e-b96a-d7180826d3bb tempest-SnapshotsActionsTest-590206117 None] Lock "cinder-5b915b8e-18f1-428c-b120-4474bacd3838-delete_snapshot" released by "delete_snapshot" :: held 2.744s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:14 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf 1G" returned: 0 in 0.535s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81361cf0-9a39-4a21-91be-2152294a5889 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:14 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81361cf0-9a39-4a21-91be-2152294a5889 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf
Apr 13 17:08:14 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:14 devstack sudo[86919]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Deleted volume successfully.
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6d114a06-a336-4533-9b9a-80d29dcc5717 tempest-VolumeSnapshotQuotasNegativeTestJSON-1547975517 None] Lock "cinder-1ea41033-cf9a-40e7-b1e3-7a4777f98043-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:14 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81361cf0-9a39-4a21-91be-2152294a5889 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:14 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf is being set with open permissions: ugo+rw
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:14 devstack sudo[86931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf
Apr 13 17:08:14 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "cinder-4d2c15a1-2acc-4b4f-b41c-0981bad81461-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-4d2c15a1-2acc-4b4f-b41c-0981bad81461-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "cinder-quobyte-4d2c15a1-2acc-4b4f-b41c-0981bad81461" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-quobyte-4d2c15a1-2acc-4b4f-b41c-0981bad81461" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Deleting offline snapshot 4d2c15a1-2acc-4b4f-b41c-0981bad81461 of volume 7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] snapshot_file for this snap is: volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d8a861-0d8a-4043-bfdd-f8ab3118e551]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:14 devstack sudo[86933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:08:14 devstack sudo[86933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:15 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:15 devstack sudo[86936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.info
Apr 13 17:08:15 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:15 devstack sudo[86933]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6037b77e-2c7c-4682-ae89-a5580db1eb79]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:15 devstack sudo[86941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929
Apr 13 17:08:15 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:15 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.info" returned: 0 in 0.560s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:15 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.info is being set with open permissions: ugo+rw
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:15 devstack sudo[86944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.info
Apr 13 17:08:15 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:15 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:15 devstack sudo[86949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:08:15 devstack sudo[86949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:16 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.info" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] snapshot: 341e0192-c3e1-47c6-96a2-1519051470bf, volume: 0b86e75f-f1ac-4275-ae2e-b2deabe33d56,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ccb49-0866-4cf6-a126-1a0ea824d199]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:16 devstack sudo[86955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf
Apr 13 17:08:16 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:16 devstack sudo[86949]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:16 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461
Apr 13 17:08:16 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:16 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf" returned: 0 in 0.574s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81361cf0-9a39-4a21-91be-2152294a5889(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[764d01b1-7741-4c63-a416-1b0024156303]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:16 devstack sudo[86965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889
Apr 13 17:08:16 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:16 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929.4d2c15a1-2acc-4b4f-b41c-0981bad81461" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-quobyte-4d2c15a1-2acc-4b4f-b41c-0981bad81461" released by "_delete_snapshot" :: held 2.265s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" released by "delete_snapshot" :: held 2.279s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:17 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Created reservations ['66d72ccc-56ef-4288-afb0-ad3f64aa42ee', '0497b69f-5fac-44c6-818a-fbca01b1b994', '6238eaac-7227-4558-b655-f9b550840f1a', 'b337b29d-e1b9-4e0f-bfa7-fdab55bcde12'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Delete snapshot completed successfully.
Apr 13 17:08:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4764c3d-a804-4f6a-8cc3-ce33f8b5edf6 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-4d2c15a1-2acc-4b4f-b41c-0981bad81461-delete_snapshot" released by "delete_snapshot" :: held 2.387s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:17 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:17 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:08:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:17 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56
Apr 13 17:08:17 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "cinder-7ecd1c08-fbea-4df8-abb9-74a08e62c929-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-7ecd1c08-fbea-4df8-abb9-74a08e62c929-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b35dd4-2ca3-4e58-8a76-2c8d994605d2]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:18 devstack sudo[87011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929
Apr 13 17:08:18 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:20 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" returned: 0 in 3.378s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[37daf302-ddac-490e-a1f1-d915919df5af]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:20 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929" returned: 0 in 2.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:20 devstack sudo[87020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889
Apr 13 17:08:20 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:20 devstack sudo[87021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929
Apr 13 17:08:20 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:21 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7ecd1c08-fbea-4df8-abb9-74a08e62c929" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-quobyte-7ecd1c08-fbea-4df8-abb9-74a08e62c929" released by "delete_volume" :: held 3.137s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Created reservations ['6678dd7c-0129-4163-a4a4-c9ecd62d82d3', 'a540a0f0-a79c-4f67-bad8-e9763de523bc', 'cfd552bc-7127-4c35-9bfe-b6efe8d28fc3', '0c3067df-bcda-4d72-ae22-2a3e86604f7b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:21 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889" returned: 0 in 0.772s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889, size 1024.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:08:21 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Converted 1024.00 MB image at 302.99 MB/s
Apr 13 17:08:21 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 is being set with open permissions: ugo+rw
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:21 devstack sudo[87028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56
Apr 13 17:08:21 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:21 devstack sudo[87030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:21 devstack sudo[87030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:22 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" returned: 0 in 0.827s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" released by "_copy_volume_from_snapshot" :: held 6.131s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-341e0192-c3e1-47c6-96a2-1519051470bf" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-341e0192-c3e1-47c6-96a2-1519051470bf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Deleting offline snapshot 341e0192-c3e1-47c6-96a2-1519051470bf of volume 81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] snapshot_file for this snap is: volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[65827c3c-073f-4837-b7e2-faf5d288ffab]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:22 devstack sudo[87030]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.874s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Deleted volume successfully.
Apr 13 17:08:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0d2bd71d-08a3-4ef3-b532-32373f7f1eb9 tempest-SnapshotsActionsTest-72178178 None] Lock "cinder-7ecd1c08-fbea-4df8-abb9-74a08e62c929-delete_volume" released by "delete_volume" :: held 4.427s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:22 devstack sudo[87035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf
Apr 13 17:08:22 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:23 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf" returned: 0 in 0.642s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81361cf0-9a39-4a21-91be-2152294a5889(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9836410f-9f13-421e-9670-59293cb22b0c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:23 devstack sudo[87040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889
Apr 13 17:08:23 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:23 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889" returned: 0 in 0.923s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:24 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf
Apr 13 17:08:24 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:25 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf" returned: 0 in 1.063s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:25 devstack sudo[87096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf
Apr 13 17:08:25 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:25 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889.341e0192-c3e1-47c6-96a2-1519051470bf" returned: 0 in 0.715s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-341e0192-c3e1-47c6-96a2-1519051470bf" released by "_delete_snapshot" :: held 3.438s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23042a7d-8399-4624-9857-296622993da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56', 'volume_size': 1, 'source_volid': '81361cf0-9a39-4a21-91be-2152294a5889', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e09081c-32a6-4a37-ba0e-b21de9e176e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Volume volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 (0b86e75f-f1ac-4275-ae2e-b2deabe33d56): created successfully
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e09081c-32a6-4a37-ba0e-b21de9e176e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (a38272f1-ba1e-4246-8511-b55477da37d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f7503a98-db43-4d60-be0f-71a0c982d2be tempest-VolumesGetTest-19600692 None] Created volume successfully.
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (939e5954-5f67-4733-8e75-94c5d58eecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae7e729-643d-435d-89ad-caf7b8f101b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae7e729-643d-435d-89ad-caf7b8f101b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1706579801',display_name='tempest-VolumesGetTest-Volume-138494445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018199dc-600f-425f-bfcb-a71aa6bf3de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:27Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af581d4-4fe5-4f06-8601-4813e423d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af581d4-4fe5-4f06-8601-4813e423d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47f7a71-bf23-4746-bb21-1ba8bf5e102d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47f7a71-bf23-4746-bb21-1ba8bf5e102d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018199dc-600f-425f-bfcb-a71aa6bf3de7', 'volume_name': 'volume-018199dc-600f-425f-bfcb-a71aa6bf3de7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bcd454-b11a-431e-844c-36e7c4d6c213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2bcd454-b11a-431e-844c-36e7c4d6c213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10434fb-b1c2-4149-b3f3-08aaf42ba80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Volume 018199dc-600f-425f-bfcb-a71aa6bf3de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018199dc-600f-425f-bfcb-a71aa6bf3de7', 'volume_size': 1}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1706579801',display_name='tempest-VolumesGetTest-Volume-138494445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018199dc-600f-425f-bfcb-a71aa6bf3de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:27Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Creating volume 018199dc-600f-425f-bfcb-a71aa6bf3de7 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:26 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:26 devstack sudo[87102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7 1073741824
Apr 13 17:08:26 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:27 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Flow 'volume_create_manager' (9922e039-d56a-4267-a9e9-495159df314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83823b1e-12e8-413f-a2b5-e7decfe23e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7 1073741824" returned: 0 in 0.952s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83823b1e-12e8-413f-a2b5-e7decfe23e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1270927691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7c63f3-e47e-4937-905a-5407d72f281a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4eda1550360429880d3dd4fa081ebad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:28Z,use_quota=True,user_id='8a3809df1ef4448fabc23516d9f5ab36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ae0178-29de-4e21-aa91-91776caabfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53ae0178-29de-4e21-aa91-91776caabfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bc3c3b-83f4-431b-b572-439667b60606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bc3c3b-83f4-431b-b572-439667b60606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7c63f3-e47e-4937-905a-5407d72f281a', 'volume_name': 'volume-3b7c63f3-e47e-4937-905a-5407d72f281a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e41aebf-0d26-4727-8822-32d2b2b7bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e41aebf-0d26-4727-8822-32d2b2b7bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b21685-e289-431b-84f1-dbb008ed7a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:27 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Volume 3b7c63f3-e47e-4937-905a-5407d72f281a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7c63f3-e47e-4937-905a-5407d72f281a', 'volume_size': 1}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:27 devstack sudo[87113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7
Apr 13 17:08:27 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:28 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7" returned: 0 in 0.649s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1270927691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7c63f3-e47e-4937-905a-5407d72f281a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4eda1550360429880d3dd4fa081ebad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:28Z,use_quota=True,user_id='8a3809df1ef4448fabc23516d9f5ab36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Creating volume 3b7c63f3-e47e-4937-905a-5407d72f281a {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:28 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:28 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a 1073741824
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10434fb-b1c2-4149-b3f3-08aaf42ba80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018199dc-600f-425f-bfcb-a71aa6bf3de7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa1604c-35b2-414f-9225-0fb75599a21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:28 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Volume volume-018199dc-600f-425f-bfcb-a71aa6bf3de7 (018199dc-600f-425f-bfcb-a71aa6bf3de7): created successfully
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa1604c-35b2-414f-9225-0fb75599a21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (939e5954-5f67-4733-8e75-94c5d58eecf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8da650ce-c770-4e0f-ac87-68a11d72368a tempest-VolumesGetTest-19600692 None] Created volume successfully.
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-018199dc-600f-425f-bfcb-a71aa6bf3de7-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Lock "cinder-018199dc-600f-425f-bfcb-a71aa6bf3de7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-018199dc-600f-425f-bfcb-a71aa6bf3de7" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-018199dc-600f-425f-bfcb-a71aa6bf3de7" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa54299-8e7d-488a-a92d-07222cbb404b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:29 devstack sudo[87137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7
Apr 13 17:08:29 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Flow 'volume_create_manager' (b425c1a8-a2c4-4084-8d5d-4de2423d9926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78346a7-c235-4f98-a867-38450d4e6d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:29 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a 1073741824" returned: 0 in 0.741s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78346a7-c235-4f98-a867-38450d4e6d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1798010943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c47201e-1707-4668-992d-f8f18fe1c987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1ee5b9659423c839cebbe9a89f417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:29Z,use_quota=True,user_id='adde01065d1d4a6e9625cef92313820c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d67d907-ed36-49fb-86a5-01d4878159b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d67d907-ed36-49fb-86a5-01d4878159b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec424a5-44d3-4bbc-80fe-b93822f161c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.image.glance [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:29 devstack sudo[87144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a
Apr 13 17:08:29 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec424a5-44d3-4bbc-80fe-b93822f161c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c47201e-1707-4668-992d-f8f18fe1c987', 'volume_name': 'volume-9c47201e-1707-4668-992d-f8f18fe1c987', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fc80fb5b0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e81d120-a765-46f9-93f1-0276130c7d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e81d120-a765-46f9-93f1-0276130c7d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec19853f-2c59-48c5-8ee9-dd32b5693f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Volume 9c47201e-1707-4668-992d-f8f18fe1c987: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c47201e-1707-4668-992d-f8f18fe1c987', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fc80fb5b0>}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Trying to clone 9c47201e-1707-4668-992d-f8f18fe1c987 from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 17:08:29 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7" returned: 0 in 0.641s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:29 devstack sudo[87150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7
Apr 13 17:08:29 devstack sudo[87150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 17:08:29 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f352d-8159-4f31-bbcd-bcb20fe1c246]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:29 devstack sudo[87153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD
Apr 13 17:08:29 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:30 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a" returned: 0 in 0.633s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b21685-e289-431b-84f1-dbb008ed7a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7c63f3-e47e-4937-905a-5407d72f281a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba31400-333a-45a1-acfa-d01a0a8d2703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Volume volume-3b7c63f3-e47e-4937-905a-5407d72f281a (3b7c63f3-e47e-4937-905a-5407d72f281a): created successfully
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba31400-333a-45a1-acfa-d01a0a8d2703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Flow 'volume_create_manager' (9922e039-d56a-4267-a9e9-495159df314c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-43e70006-f1c6-44bf-9c05-bbde813563be tempest-VolumeQuotasNegativeTestJSON-780783719 None] Created volume successfully.
Apr 13 17:08:30 devstack sudo[87150]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-018199dc-600f-425f-bfcb-a71aa6bf3de7" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-018199dc-600f-425f-bfcb-a71aa6bf3de7" released by "delete_volume" :: held 1.145s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Created reservations ['b267385c-6dc5-4e25-bb50-c881a4bb67dd', '819c6d07-1924-40da-a89b-7781d347e63d', 'f389dfed-7fb9-4adf-aedf-a7eca803b761', 'f7d8994a-038e-47e9-95b7-a2605b434973'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:30 devstack sudo[87157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:30 devstack sudo[87157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:30 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 is fetched for user adde01065d1d4a6e9625cef92313820c. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f901e77e-5bcd-4b92-abb3-85afd71cdb3c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:30 devstack sudo[87162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD
Apr 13 17:08:30 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:30 devstack sudo[87157]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Deleted volume successfully.
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5da7cf4c-393e-410b-a68c-8cb5240e7269 tempest-VolumesGetTest-19600692 None] Lock "cinder-018199dc-600f-425f-bfcb-a71aa6bf3de7-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-3bf7532c-08fd-4fbb-9c33-7523eb035bc1 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Terminate volume connection completed successfully.
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-3bf7532c-08fd-4fbb-9c33-7523eb035bc1 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Deleting attachment 08acab1f-3301-4458-a988-7b1dd70109eb. {{(pid=82641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 17:08:30 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1798010943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c47201e-1707-4668-992d-f8f18fe1c987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b1ee5b9659423c839cebbe9a89f417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:29Z,use_quota=True,user_id='adde01065d1d4a6e9625cef92313820c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Creating volume 9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:30 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:30 devstack sudo[87168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 1073741824
Apr 13 17:08:30 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-0b86e75f-f1ac-4275-ae2e-b2deabe33d56-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Lock "cinder-0b86e75f-f1ac-4275-ae2e-b2deabe33d56-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "cinder-56068c80-a969-4704-89e6-06d6d3bc442f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-56068c80-a969-4704-89e6-06d6d3bc442f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e515f4-3807-4582-93ec-e1a050b04fca]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "cinder-quobyte-56068c80-a969-4704-89e6-06d6d3bc442f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-quobyte-56068c80-a969-4704-89e6-06d6d3bc442f" acquired by "delete_volume" :: waited 0.023s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:31 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 1073741824" returned: 0 in 0.664s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:31 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56
Apr 13 17:08:31 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c6991-302a-4641-8767-faa9c159dd6c]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Acquiring lock "cinder-3b7c63f3-e47e-4937-905a-5407d72f281a-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:31 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987
Apr 13 17:08:31 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:31 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:08:31 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "cinder-3b7c63f3-e47e-4937-905a-5407d72f281a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Acquiring lock "cinder-quobyte-3b7c63f3-e47e-4937-905a-5407d72f281a" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "cinder-quobyte-3b7c63f3-e47e-4937-905a-5407d72f281a" acquired by "delete_volume" :: waited 0.053s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf7d10f-c34f-4e9b-932f-10b10e8d0f2a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:31 devstack sudo[87179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a
Apr 13 17:08:31 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" returned: 0 in 0.616s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:32 devstack sudo[87185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56
Apr 13 17:08:32 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987" returned: 0 in 0.581s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Attempting download of 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume 9c47201e-1707-4668-992d-f8f18fe1c987. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 17:08:32 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 0 in 0.632s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6c0aac-0d5b-41d3-b585-cea104af5b8c]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_7zxyrymm {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:32 devstack sudo[87189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:08:32 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_7zxyrymm
Apr 13 17:08:32 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a" returned: 0 in 0.653s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:32 devstack sudo[87196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a
Apr 13 17:08:32 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-0b86e75f-f1ac-4275-ae2e-b2deabe33d56" released by "delete_volume" :: held 1.144s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Created reservations ['f0f8b916-24fb-461f-b9aa-fd0727c84ee9', 'e9ac1eca-d781-4abd-b602-e53566fdca72', 'a9a03416-ce46-4be6-a2a0-9999418f942b', '63fbfc0a-bb7b-4bda-8644-cfecd7b96595'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:32 devstack sudo[87203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:32 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_7zxyrymm" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_7zxyrymm {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:32 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 1 in 0.619s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:32 devstack sudo[87207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f
Apr 13 17:08:32 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_7zxyrymm
Apr 13 17:08:32 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:32 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b7c63f3-e47e-4937-905a-5407d72f281a" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "cinder-quobyte-3b7c63f3-e47e-4937-905a-5407d72f281a" released by "delete_volume" :: held 1.194s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Created reservations ['2838c3f4-351b-40e2-b2bb-f286ba6c45f3', '91d3dc28-2f0a-4fe6-955d-c7141afc4a78', 'd149a689-def2-40c0-8121-60040b00cad9', '99ba6788-1e59-48e2-b300-31bbc69c3de3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:33 devstack sudo[87211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:33 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:33 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Deleted volume successfully.
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4c0c4463-35cd-49c9-ad3d-1984039f5fc1 tempest-VolumesGetTest-19600692 None] Lock "cinder-0b86e75f-f1ac-4275-ae2e-b2deabe33d56-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:33 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:33 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_7zxyrymm" returned: 1 in 0.544s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_7zxyrymm' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-56068c80-a969-4704-89e6-06d6d3bc442f" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f73ec8-88ea-490c-8675-a4ab2a6204b1]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-quobyte-56068c80-a969-4704-89e6-06d6d3bc442f" released by "delete_volume" :: held 1.805s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.quota [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Created reservations ['0e0a76ac-87bf-41f5-b869-5b837bc77e0d', 'df8e3df8-3598-4e37-927c-7d40490aab71', 'a2aff4d7-7a4d-4d70-aac7-6f0313311d40', '2ff7d1a7-44e7-41e8-a82d-80a685695c76'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:33 devstack sudo[87217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD
Apr 13 17:08:33 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:33 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:33 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:33 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Deleted volume successfully.
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-610f749b-8b84-4344-a61c-ce4e74f97188 tempest-VolumeQuotasNegativeTestJSON-780783719 None] Lock "cinder-3b7c63f3-e47e-4937-905a-5407d72f281a-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-81361cf0-9a39-4a21-91be-2152294a5889-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Lock "cinder-81361cf0-9a39-4a21-91be-2152294a5889-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-81361cf0-9a39-4a21-91be-2152294a5889" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-81361cf0-9a39-4a21-91be-2152294a5889" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1422c5c9-88d1-45d7-a736-dac6927395eb]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:33 devstack sudo[87222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889
Apr 13 17:08:33 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:33 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:33 devstack sudo[87228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987
Apr 13 17:08:33 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:33 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.507s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.manager [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Deleted volume successfully.
Apr 13 17:08:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-02ae854e-b996-4ebc-bbd8-edcfea0402b9 req-faa1a0a7-6546-43d3-9140-25555d845cc5 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-56068c80-a969-4704-89e6-06d6d3bc442f-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:34 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:34 devstack sudo[87233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889
Apr 13 17:08:34 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:34 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-81361cf0-9a39-4a21-91be-2152294a5889" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-81361cf0-9a39-4a21-91be-2152294a5889" released by "delete_volume" :: held 1.104s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Created reservations ['d5ea77e8-c770-4b4f-9ddd-750d50cf7ab1', 'cfa4f7fd-d7c3-4b97-b938-b200d86920fb', 'ebe445dc-e0b2-4fe7-8477-4b8b5ea875ea', 'ac985322-3a2c-4e20-b823-f613e771eb44'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:35 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:35 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:35 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987" returned: 0 in 1.146s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_omer2askdevstack@QuobyteHD, size 112.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:08:35 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Converted 112.00 MB image at 97.60 MB/s
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:35 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 1G
Apr 13 17:08:35 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:35 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Deleted volume successfully.
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bc65cc-daca-4667-80fd-730cf79c8bd6 tempest-VolumesGetTest-19600692 None] Lock "cinder-81361cf0-9a39-4a21-91be-2152294a5889-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:35 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 1G" returned: 0 in 0.578s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ffb3c-caad-46c1-80d6-116c8a65c1a5]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:35 devstack sudo[87259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987
Apr 13 17:08:35 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (072746ef-2ec3-4bfd-8c58-bfd78ff8b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebc9981-df4e-4aad-8b41-440832b3422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:36 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987" returned: 0 in 0.823s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aebc9981-df4e-4aad-8b41-440832b3422a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1886822068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d834b222-eb5c-4692-ac0a-66f3e304b219,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:36Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d823f98-d981-40b8-9ebf-f9a90b828505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d823f98-d981-40b8-9ebf-f9a90b828505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f98269a-703f-44ee-b0cc-482efde270fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.image.glance [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 17:08:36 devstack sudo[87290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987
Apr 13 17:08:36 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f98269a-703f-44ee-b0cc-482efde270fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd834b222-eb5c-4692-ac0a-66f3e304b219', 'volume_name': 'volume-d834b222-eb5c-4692-ac0a-66f3e304b219', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd2385900>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ea7d78-dce9-46bd-8983-23da3bc4491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ea7d78-dce9-46bd-8983-23da3bc4491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ba5239-efda-47e5-8574-3c5ec79683b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Volume d834b222-eb5c-4692-ac0a-66f3e304b219: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d834b222-eb5c-4692-ac0a-66f3e304b219', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd2385900>}
Apr 13 17:08:36 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Trying to clone d834b222-eb5c-4692-ac0a-66f3e304b219 from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 17:08:37 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcce0384-aee9-4549-9a06-ed6195b3d16e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:37 devstack sudo[87296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD
Apr 13 17:08:37 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:37 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987" returned: 1 in 0.658s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Downloaded image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume 9c47201e-1707-4668-992d-f8f18fe1c987 successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 for user adde01065d1d4a6e9625cef92313820c is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Marking volume 9c47201e-1707-4668-992d-f8f18fe1c987 as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Copying metadata from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 to 9c47201e-1707-4668-992d-f8f18fe1c987. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Creating volume glance metadata for volume 9c47201e-1707-4668-992d-f8f18fe1c987 backed by image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec19853f-2c59-48c5-8ee9-dd32b5693f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c47201e-1707-4668-992d-f8f18fe1c987', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fc80fb5b0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2714d47-ecf5-4151-8c09-20f621122ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Volume volume-9c47201e-1707-4668-992d-f8f18fe1c987 (9c47201e-1707-4668-992d-f8f18fe1c987): created successfully
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2714d47-ecf5-4151-8c09-20f621122ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Flow 'volume_create_manager' (b425c1a8-a2c4-4084-8d5d-4de2423d9926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-28caf807-92f6-405f-8daa-ff0303d973b1 tempest-VolumesImageMetadata-1825653595 None] Created volume successfully.
Apr 13 17:08:37 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 is fetched for user b4eed3594582455caddf9ac01d4e67b8. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[46510e32-f6e7-476b-8a9d-e3cd8591a78e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:37 devstack sudo[87303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD
Apr 13 17:08:37 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Acquiring lock "cinder-9c47201e-1707-4668-992d-f8f18fe1c987-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Lock "cinder-9c47201e-1707-4668-992d-f8f18fe1c987-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Acquiring lock "cinder-quobyte-9c47201e-1707-4668-992d-f8f18fe1c987" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Lock "cinder-quobyte-9c47201e-1707-4668-992d-f8f18fe1c987" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5208c3-2b00-41a1-8226-b54b8db66faa]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:38 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1886822068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d834b222-eb5c-4692-ac0a-66f3e304b219,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:36Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Creating volume d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:38 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:38 devstack sudo[87309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 1073741824
Apr 13 17:08:38 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:38 devstack sudo[87308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987
Apr 13 17:08:38 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:38 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:38 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987
Apr 13 17:08:38 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:38 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 1073741824" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:38 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219
Apr 13 17:08:38 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Flow 'volume_create_manager' (730289b1-1b45-4f55-bfe3-5552efd02d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dd58d3-4be0-4915-9a77-ae28809ceeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dd58d3-4be0-4915-9a77-ae28809ceeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1744449860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33735c08-3d1e-4636-bdf8-c559c5ebeeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb430703bda3438882cb792110251ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:39Z,use_quota=True,user_id='c145b7c5f7b5452b81a8650725a9b205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4373b263-21cd-4ed4-9dec-981b1a429013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4373b263-21cd-4ed4-9dec-981b1a429013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0089d8a-06ed-431c-a643-d8566c319592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0089d8a-06ed-431c-a643-d8566c319592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33735c08-3d1e-4636-bdf8-c559c5ebeeac', 'volume_name': 'volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42720d4a-59c5-4029-a16f-1e1278157eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42720d4a-59c5-4029-a16f-1e1278157eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c506be-62b6-4fec-9d00-98685067659d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:39 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Volume 33735c08-3d1e-4636-bdf8-c559c5ebeeac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac', 'volume_size': 1}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:39 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987" returned: 1 in 0.556s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:39 devstack sudo[87326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987
Apr 13 17:08:39 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:39 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1744449860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33735c08-3d1e-4636-bdf8-c559c5ebeeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb430703bda3438882cb792110251ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:39Z,use_quota=True,user_id='c145b7c5f7b5452b81a8650725a9b205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Creating volume 33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:39 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Attempting download of 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume d834b222-eb5c-4692-ac0a-66f3e304b219. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 17:08:39 devstack sudo[87328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac 1073741824
Apr 13 17:08:39 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b926a2e-399e-48f3-9ccf-4124d5411dcf]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_47tb1jin {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:39 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_47tb1jin
Apr 13 17:08:39 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:39 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9c47201e-1707-4668-992d-f8f18fe1c987" returned: 0 in 0.515s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Lock "cinder-quobyte-9c47201e-1707-4668-992d-f8f18fe1c987" released by "delete_volume" :: held 1.659s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:39 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac 1073741824" returned: 0 in 0.502s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Created reservations ['5436f7f5-4218-49dc-8deb-0925fa307bc2', 'f19bb0a6-45ca-434f-b3ef-ec6d29a6bb7a', '8f2fb982-d083-4ce0-8c05-b09cafb19c5d', '7069d603-0efa-4554-aaa3-e176e1c030fd'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:39 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_47tb1jin" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:39 devstack sudo[87338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac
Apr 13 17:08:39 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_47tb1jin {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:40 devstack sudo[87340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_47tb1jin
Apr 13 17:08:40 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:40 devstack sudo[87341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:40 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:40 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c506be-62b6-4fec-9d00-98685067659d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7e5ea4-4787-4e40-8c90-e5fcecf312f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:40 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Volume volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac (33735c08-3d1e-4636-bdf8-c559c5ebeeac): created successfully
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7e5ea4-4787-4e40-8c90-e5fcecf312f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Flow 'volume_create_manager' (730289b1-1b45-4f55-bfe3-5552efd02d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1b505b45-5f8b-4de6-82d5-a3c81f3644c2 tempest-SnapshotMetadataTestJSON-880213403 None] Created volume successfully.
Apr 13 17:08:40 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_47tb1jin" returned: 1 in 0.513s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_47tb1jin' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ab9e17-7e7b-443d-8b22-a6c7eb6c891e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:40 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.486s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Deleted volume successfully.
Apr 13 17:08:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c01519b4-18c8-447c-95d3-ed2be897ecdf tempest-VolumesImageMetadata-1825653595 None] Lock "cinder-9c47201e-1707-4668-992d-f8f18fe1c987-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:40 devstack sudo[87348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD
Apr 13 17:08:40 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:41 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:41 devstack sudo[87353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219
Apr 13 17:08:41 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Creating offline snapshot 113d36eb-c215-444a-beec-18f2e2c125e4 of volume 33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6638e493-59c5-473d-a103-a781597c8d51]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:41 devstack sudo[87356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac
Apr 13 17:08:41 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:42 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219" returned: 0 in 1.089s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_wktaq6rrdevstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:08:42 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Converted 112.00 MB image at 102.67 MB/s
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:42 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:42 devstack sudo[87368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 1G
Apr 13 17:08:42 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac" returned: 0 in 0.666s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:42 devstack sudo[87377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 1G
Apr 13 17:08:42 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:42 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 1G" returned: 0 in 0.740s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec872c5-05cf-4627-96c2-6c154e469fa0]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:42 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 1G" returned: 0 in 0.756s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:42 devstack sudo[87404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4
Apr 13 17:08:42 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:42 devstack sudo[87402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219
Apr 13 17:08:42 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Flow 'volume_create_manager' (8372b105-7a56-4723-8c55-2b4b21c06e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345aadad-4647-48c6-970e-3bfb7a95018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345aadad-4647-48c6-970e-3bfb7a95018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1652310988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b55d135-6554-4281-a228-623c9aece189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017d01eeadf6483bbbca9b52a7ccad76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:43Z,use_quota=True,user_id='7b3f1246c72f4d3682ea257239e0c1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42648dc-7c3f-4692-80be-723f45549062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42648dc-7c3f-4692-80be-723f45549062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc0bbee-c37a-4c5a-8c05-98388aed11b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dc0bbee-c37a-4c5a-8c05-98388aed11b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b55d135-6554-4281-a228-623c9aece189', 'volume_name': 'volume-2b55d135-6554-4281-a228-623c9aece189', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25392cb-7346-46de-901d-a1193e1db98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25392cb-7346-46de-901d-a1193e1db98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199c2d5d-a322-4296-a29f-6865c68980a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Volume 2b55d135-6554-4281-a228-623c9aece189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b55d135-6554-4281-a228-623c9aece189', 'volume_size': 1}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:43 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:43 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 is being set with open permissions: ugo+rw
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:43 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219" returned: 0 in 0.524s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:43 devstack sudo[87412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4
Apr 13 17:08:43 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:43 devstack sudo[87414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219
Apr 13 17:08:43 devstack sudo[87414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:43 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:43 devstack sudo[87421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.info
Apr 13 17:08:43 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:43 devstack sudo[87414]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219" returned: 1 in 0.559s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Downloaded image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume d834b222-eb5c-4692-ac0a-66f3e304b219 successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 for user b4eed3594582455caddf9ac01d4e67b8 is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 17:08:43 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Marking volume d834b222-eb5c-4692-ac0a-66f3e304b219 as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Copying metadata from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 to d834b222-eb5c-4692-ac0a-66f3e304b219. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Creating volume glance metadata for volume d834b222-eb5c-4692-ac0a-66f3e304b219 backed by image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ba5239-efda-47e5-8574-3c5ec79683b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d834b222-eb5c-4692-ac0a-66f3e304b219', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd2385900>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a559f7-35cc-47c0-a056-f2a7965245cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:44 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Volume volume-d834b222-eb5c-4692-ac0a-66f3e304b219 (d834b222-eb5c-4692-ac0a-66f3e304b219): created successfully
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a559f7-35cc-47c0-a056-f2a7965245cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (072746ef-2ec3-4bfd-8c58-bfd78ff8b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8d4afeaf-3352-40c4-bdcc-d0955d0c6aa9 tempest-VolumesGetTest-19600692 None] Created volume successfully.
Apr 13 17:08:44 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.info" returned: 0 in 0.434s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:44 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.info is being set with open permissions: ugo+rw
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:44 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.info
Apr 13 17:08:44 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:44 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.info" returned: 0 in 0.413s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1652310988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b55d135-6554-4281-a228-623c9aece189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017d01eeadf6483bbbca9b52a7ccad76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:43Z,use_quota=True,user_id='7b3f1246c72f4d3682ea257239e0c1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Creating volume 2b55d135-6554-4281-a228-623c9aece189 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:44 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:44 devstack sudo[87428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189 1073741824
Apr 13 17:08:44 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1f8d4840-09fd-4ed3-895b-22f0a0bf42fd tempest-SnapshotMetadataTestJSON-880213403 None] Create snapshot completed successfully
Apr 13 17:08:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-3219c149-f443-447b-ba9b-e5dab10cab30 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Terminate volume connection completed successfully.
Apr 13 17:08:44 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-3219c149-f443-447b-ba9b-e5dab10cab30 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Deleting attachment d8014a6f-a85d-4d17-865e-dba2a8710c04. {{(pid=82641) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 13 17:08:45 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189 1073741824" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:45 devstack sudo[87433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189
Apr 13 17:08:45 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (d9b1f884-6b9d-44a2-9f16-54489092b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e54a573-3fa0-404b-a7e2-e5060748d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e54a573-3fa0-404b-a7e2-e5060748d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876320413',display_name='tempest-VolumesGetTest-Volume-1534753226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70953840-9f98-4d35-9b1b-38d67f026c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:45Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2223e551-72d0-4744-bde8-15fd43bfe83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2223e551-72d0-4744-bde8-15fd43bfe83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e15902b-b04e-42d7-981a-b4b824083ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e15902b-b04e-42d7-981a-b4b824083ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70953840-9f98-4d35-9b1b-38d67f026c2c', 'volume_name': 'volume-70953840-9f98-4d35-9b1b-38d67f026c2c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45ff889-f170-4b70-9e80-93ad4b7bd3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45ff889-f170-4b70-9e80-93ad4b7bd3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f48f13-a589-4503-9cab-53964c036426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Volume 70953840-9f98-4d35-9b1b-38d67f026c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70953840-9f98-4d35-9b1b-38d67f026c2c', 'volume_size': 1}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "cinder-9820fd84-ae51-419b-a552-9cef76e865a1-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-9820fd84-ae51-419b-a552-9cef76e865a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "cinder-quobyte-9820fd84-ae51-419b-a552-9cef76e865a1" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-quobyte-9820fd84-ae51-419b-a552-9cef76e865a1" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f92f5c0-2cb5-4e58-bce4-f47a28f88a27]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:45 devstack sudo[87435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1
Apr 13 17:08:45 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:45 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-876320413',display_name='tempest-VolumesGetTest-Volume-1534753226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70953840-9f98-4d35-9b1b-38d67f026c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f10804fcf304022917984c05b4569fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:45Z,use_quota=True,user_id='b4eed3594582455caddf9ac01d4e67b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Creating volume 70953840-9f98-4d35-9b1b-38d67f026c2c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:45 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199c2d5d-a322-4296-a29f-6865c68980a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b55d135-6554-4281-a228-623c9aece189', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704c1063-d327-48fb-a130-9491ae03b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:45 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c 1073741824
Apr 13 17:08:45 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Volume volume-2b55d135-6554-4281-a228-623c9aece189 (2b55d135-6554-4281-a228-623c9aece189): created successfully
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (704c1063-d327-48fb-a130-9491ae03b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Flow 'volume_create_manager' (8372b105-7a56-4723-8c55-2b4b21c06e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0809246f-20f0-4e32-894e-695f5da9d9b8 tempest-AbsoluteLimitsTests-641988392 None] Created volume successfully.
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "cinder-113d36eb-c215-444a-beec-18f2e2c125e4-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-113d36eb-c215-444a-beec-18f2e2c125e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "cinder-quobyte-33735c08-3d1e-4636-bdf8-c559c5ebeeac" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-quobyte-33735c08-3d1e-4636-bdf8-c559c5ebeeac" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "cinder-quobyte-113d36eb-c215-444a-beec-18f2e2c125e4" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-quobyte-113d36eb-c215-444a-beec-18f2e2c125e4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Deleting offline snapshot 113d36eb-c215-444a-beec-18f2e2c125e4 of volume 33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] snapshot_file for this snap is: volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab8fa33-7cf0-40cb-a30b-5369b4e44143]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:46 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4
Apr 13 17:08:46 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:46 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1" returned: 0 in 0.670s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:46 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1
Apr 13 17:08:46 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Acquiring lock "cinder-2b55d135-6554-4281-a228-623c9aece189-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Lock "cinder-2b55d135-6554-4281-a228-623c9aece189-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Acquiring lock "cinder-quobyte-2b55d135-6554-4281-a228-623c9aece189" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Lock "cinder-quobyte-2b55d135-6554-4281-a228-623c9aece189" acquired by "delete_volume" :: waited 0.028s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:46 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c 1073741824" returned: 0 in 0.663s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d4ec1d-e93a-4c98-bee1-d9d38a45b4c3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:46 devstack sudo[87451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c
Apr 13 17:08:46 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:46 devstack sudo[87450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189
Apr 13 17:08:46 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:46 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9820fd84-ae51-419b-a552-9cef76e865a1" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-quobyte-9820fd84-ae51-419b-a552-9cef76e865a1" released by "delete_volume" :: held 1.167s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:46 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4" returned: 0 in 0.626s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d1e72a-6d1e-4064-9e4c-8523460d025b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.quota [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Created reservations ['ed0bda18-4047-45eb-9c09-a564b42249c4', '390cbb98-4b7d-4703-9df9-539f0d85e520', '06803472-bc62-4fa2-8460-d749a8d446e0', '65c16c4f-8869-4444-a061-2d5d3b46b164'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:46 devstack sudo[87458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac
Apr 13 17:08:46 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:46 devstack sudo[87464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:46 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:46 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f48f13-a589-4503-9cab-53964c036426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70953840-9f98-4d35-9b1b-38d67f026c2c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4e1100-6b48-437e-b8f8-57001ecc9a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:47 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Volume volume-70953840-9f98-4d35-9b1b-38d67f026c2c (70953840-9f98-4d35-9b1b-38d67f026c2c): created successfully
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4e1100-6b48-437e-b8f8-57001ecc9a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Flow 'volume_create_manager' (d9b1f884-6b9d-44a2-9f16-54489092b598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189" returned: 0 in 0.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ec9cce5b-f1d1-491a-bda7-a5e149ba37bb tempest-VolumesGetTest-19600692 None] Created volume successfully.
Apr 13 17:08:47 devstack sudo[87466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189
Apr 13 17:08:47 devstack sudo[87466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:47 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac" returned: 0 in 0.588s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:47 devstack sudo[87473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4
Apr 13 17:08:47 devstack sudo[87473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:47 devstack sudo[87466]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2b55d135-6554-4281-a228-623c9aece189" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Lock "cinder-quobyte-2b55d135-6554-4281-a228-623c9aece189" released by "delete_volume" :: held 0.987s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:47 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.533s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.manager [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Deleted volume successfully.
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [req-8ffce805-4cca-41da-9082-e65430f50dc5 req-9c21901d-f89a-42f5-b854-ace130a31d94 tempest-ServerBootFromVolumeStableRescueTest-505035589 None] Lock "cinder-9820fd84-ae51-419b-a552-9cef76e865a1-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Created reservations ['3cab13c0-3553-4f44-81c1-eebc614876fa', '8f1e51d1-c271-4f57-b48a-9f5d24257018', 'f93e6e3a-bb41-43eb-9796-593817137bf6', '240563d1-3222-4cb2-80e3-b30dcdee9fdb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:47 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:47 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-70953840-9f98-4d35-9b1b-38d67f026c2c-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Lock "cinder-70953840-9f98-4d35-9b1b-38d67f026c2c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-70953840-9f98-4d35-9b1b-38d67f026c2c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-70953840-9f98-4d35-9b1b-38d67f026c2c" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6ddc20-d8cb-4c2d-90d2-61e6d630d234]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:47 devstack sudo[87477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c
Apr 13 17:08:47 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:47 devstack sudo[87473]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4" returned: 0 in 0.501s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:47 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4
Apr 13 17:08:47 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:48 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Deleted volume successfully.
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b7a3ea39-a3a9-4242-bed3-c42b56e5dc4a tempest-AbsoluteLimitsTests-641988392 None] Lock "cinder-2b55d135-6554-4281-a228-623c9aece189-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:48 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:48 devstack sudo[87488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c
Apr 13 17:08:48 devstack sudo[87488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:48 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac.113d36eb-c215-444a-beec-18f2e2c125e4" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-quobyte-113d36eb-c215-444a-beec-18f2e2c125e4" released by "_delete_snapshot" :: held 2.171s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-quobyte-33735c08-3d1e-4636-bdf8-c559c5ebeeac" released by "delete_snapshot" :: held 2.197s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Created reservations ['f3b138b4-733d-402b-b62a-5a8bc2d3a81d', '999aa0f8-bddc-4d40-b3c2-3fa42989e6c8', '480b5de9-748a-4cae-98d4-08fcef13cd76', '3c5bdebb-036e-4ede-bdf9-efdb59c3ccdf'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Delete snapshot completed successfully.
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ce5c5000-a740-4bbf-8c61-8aa8b4cd20ec tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-113d36eb-c215-444a-beec-18f2e2c125e4-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:48 devstack sudo[87488]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-70953840-9f98-4d35-9b1b-38d67f026c2c" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-70953840-9f98-4d35-9b1b-38d67f026c2c" released by "delete_volume" :: held 0.987s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Created reservations ['0d9001f1-a0db-4d0c-9e26-8e90a9d8252b', 'd7626127-e768-452d-b39a-dfff3dbfd9c2', '0c291627-7238-4f05-9170-329aba4d6fa8', '0922fddd-eb3a-4861-b3e6-d1da497bec91'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:48 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:48 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-d834b222-eb5c-4692-ac0a-66f3e304b219-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Lock "cinder-d834b222-eb5c-4692-ac0a-66f3e304b219-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Acquiring lock "cinder-quobyte-d834b222-eb5c-4692-ac0a-66f3e304b219" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-d834b222-eb5c-4692-ac0a-66f3e304b219" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2180d89e-399f-42dd-bc30-306a98422be7]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:49 devstack sudo[87497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219
Apr 13 17:08:49 devstack sudo[87497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "cinder-33735c08-3d1e-4636-bdf8-c559c5ebeeac-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-33735c08-3d1e-4636-bdf8-c559c5ebeeac-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "cinder-quobyte-33735c08-3d1e-4636-bdf8-c559c5ebeeac" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-quobyte-33735c08-3d1e-4636-bdf8-c559c5ebeeac" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:49 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.622s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Deleted volume successfully.
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40dd84-6b35-493a-9a38-02782def47ec]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ab694bc6-2f31-4b6e-a922-744a010312ef tempest-VolumesGetTest-19600692 None] Lock "cinder-70953840-9f98-4d35-9b1b-38d67f026c2c-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:49 devstack sudo[87501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac
Apr 13 17:08:49 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:49 devstack sudo[87497]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219" returned: 0 in 0.646s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:49 devstack sudo[87505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219
Apr 13 17:08:49 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:50 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac" returned: 0 in 0.604s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:50 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac
Apr 13 17:08:50 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:50 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219" returned: 1 in 0.699s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:50 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219
Apr 13 17:08:50 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:50 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-33735c08-3d1e-4636-bdf8-c559c5ebeeac" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-quobyte-33735c08-3d1e-4636-bdf8-c559c5ebeeac" released by "delete_volume" :: held 1.147s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Created reservations ['2a4a6b74-29cc-46b0-a2b8-b43201398fc7', 'c0202d53-a33b-4ba6-a4dd-16d7fced2103', '80362895-febb-417e-9e59-a5272189a773', '1849f499-40bd-4933-a3b4-f1120b0937d9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:50 devstack sudo[87551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:50 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:50 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d834b222-eb5c-4692-ac0a-66f3e304b219" returned: 0 in 0.501s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Lock "cinder-quobyte-d834b222-eb5c-4692-ac0a-66f3e304b219" released by "delete_volume" :: held 1.890s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Created reservations ['6f2ff7be-a7a2-42f2-b357-d73fb5f9a842', 'b9266541-dbec-42c7-b124-51e9ee995958', '301762a4-ac59-4cff-8e5f-218408b1018d', 'ff5efac0-8eff-46a1-bce6-c084e15304a9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:50 devstack sudo[87554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:50 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:51 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.574s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:51 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Deleted volume successfully.
Apr 13 17:08:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5a317efd-6e30-4974-8344-e71126bc9f56 tempest-SnapshotMetadataTestJSON-880213403 None] Lock "cinder-33735c08-3d1e-4636-bdf8-c559c5ebeeac-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:51 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.510s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:51 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Deleted volume successfully.
Apr 13 17:08:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-499a0643-d657-4e38-b991-f0baa8f3ea21 tempest-VolumesGetTest-19600692 None] Lock "cinder-d834b222-eb5c-4692-ac0a-66f3e304b219-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:51 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Flow 'volume_create_manager' (18bd19ee-4ee7-4136-975a-278c87e0e9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab5cfcd-1fb7-40d3-bd52-321beb7fcb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ab5cfcd-1fb7-40d3-bd52-321beb7fcb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-408993902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161469ea-095f-46b4-9990-955e2b9f79f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ff70d3cb44ba0999f029b41cdd175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:52Z,use_quota=True,user_id='7d7753a12d0b43f0866f0af472a6a44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163e99f2-7f48-49a7-a041-1632cd781099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163e99f2-7f48-49a7-a041-1632cd781099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099b4521-3283-482d-9b57-9d1eba991837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (099b4521-3283-482d-9b57-9d1eba991837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161469ea-095f-46b4-9990-955e2b9f79f6', 'volume_name': 'volume-161469ea-095f-46b4-9990-955e2b9f79f6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a610ef9c-8743-4c9b-b503-36abd90fe8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a610ef9c-8743-4c9b-b503-36abd90fe8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07ccce7-18ce-4b5f-9ac8-08ba583f9d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:52 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Volume 161469ea-095f-46b4-9990-955e2b9f79f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161469ea-095f-46b4-9990-955e2b9f79f6', 'volume_size': 1}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-408993902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161469ea-095f-46b4-9990-955e2b9f79f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='456ff70d3cb44ba0999f029b41cdd175',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:52Z,use_quota=True,user_id='7d7753a12d0b43f0866f0af472a6a44d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Creating volume 161469ea-095f-46b4-9990-955e2b9f79f6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:52 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:52 devstack sudo[87560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6 1073741824
Apr 13 17:08:52 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:52 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6 1073741824" returned: 0 in 0.598s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:52 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6
Apr 13 17:08:52 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:53 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07ccce7-18ce-4b5f-9ac8-08ba583f9d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161469ea-095f-46b4-9990-955e2b9f79f6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9ce8d3-757b-43ea-8329-343f7d51dd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Volume volume-161469ea-095f-46b4-9990-955e2b9f79f6 (161469ea-095f-46b4-9990-955e2b9f79f6): created successfully
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9ce8d3-757b-43ea-8329-343f7d51dd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Flow 'volume_create_manager' (18bd19ee-4ee7-4136-975a-278c87e0e9e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bdb8d50f-67d0-4151-a9df-658158dc6829 tempest-VolumesMetadataTest-493840476 None] Created volume successfully.
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (a3b21740-d48b-4c17-8500-92cb1788c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012c9d32-bf6e-405c-959d-3f99d9660b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012c9d32-bf6e-405c-959d-3f99d9660b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965540768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72333508-62d2-4c33-8fe7-2e78adf2cab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:53Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f02f9d3-adc3-43f7-a61a-3bfdae5ab864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f02f9d3-adc3-43f7-a61a-3bfdae5ab864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9249e7aa-e037-468b-94dc-018e679eb4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9249e7aa-e037-468b-94dc-018e679eb4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72333508-62d2-4c33-8fe7-2e78adf2cab2', 'volume_name': 'volume-72333508-62d2-4c33-8fe7-2e78adf2cab2', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62fd04a-cc2f-458c-bbf3-ced91ca7c308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c62fd04a-cc2f-458c-bbf3-ced91ca7c308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89da8a8e-f661-4974-877e-71ccad1649d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume 72333508-62d2-4c33-8fe7-2e78adf2cab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72333508-62d2-4c33-8fe7-2e78adf2cab2', 'volume_size': 1}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1965540768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72333508-62d2-4c33-8fe7-2e78adf2cab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:53Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Creating volume 72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:53 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:53 devstack sudo[87568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 1073741824
Apr 13 17:08:53 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:54 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 1073741824" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:54 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2
Apr 13 17:08:54 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:54 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89da8a8e-f661-4974-877e-71ccad1649d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72333508-62d2-4c33-8fe7-2e78adf2cab2', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5eff4b7-1e18-4c42-bf96-dc520efc5a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 (72333508-62d2-4c33-8fe7-2e78adf2cab2): created successfully
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5eff4b7-1e18-4c42-bf96-dc520efc5a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (a3b21740-d48b-4c17-8500-92cb1788c75e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f8b1408c-208c-4d10-ba51-323602e2a269 tempest-CreateVolumesFromSnapshotTest-167663706 None] Created volume successfully.
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Flow 'volume_create_manager' (e7296840-2b9e-4ff7-9cd0-11028aa178b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4ee6c7-1274-4ca8-8139-5dd4836b8657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Acquiring lock "cinder-161469ea-095f-46b4-9990-955e2b9f79f6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4ee6c7-1274-4ca8-8139-5dd4836b8657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1896729337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d76e71-6d38-4d0c-801b-75b3183bc964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0ca91c281448448fb125d20f3513c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:55Z,use_quota=True,user_id='f072665f9cf0453a95d2039e3edfff2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98cb223-5516-46e5-82ca-ee5194d09433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98cb223-5516-46e5-82ca-ee5194d09433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccaa00f-230e-4d96-8085-f3cc08504c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccaa00f-230e-4d96-8085-f3cc08504c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d76e71-6d38-4d0c-801b-75b3183bc964', 'volume_name': 'volume-85d76e71-6d38-4d0c-801b-75b3183bc964', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e839172f-fa4e-46ab-ac90-e0b62cde0a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e839172f-fa4e-46ab-ac90-e0b62cde0a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908070b4-28dc-4c8d-ad3f-86dd6484120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Volume 85d76e71-6d38-4d0c-801b-75b3183bc964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d76e71-6d38-4d0c-801b-75b3183bc964', 'volume_size': 1}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1896729337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85d76e71-6d38-4d0c-801b-75b3183bc964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0ca91c281448448fb125d20f3513c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:08:55Z,use_quota=True,user_id='f072665f9cf0453a95d2039e3edfff2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Creating volume 85d76e71-6d38-4d0c-801b-75b3183bc964 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:08:54 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Lock "cinder-161469ea-095f-46b4-9990-955e2b9f79f6-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:54 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964 1073741824
Apr 13 17:08:54 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Acquiring lock "cinder-quobyte-161469ea-095f-46b4-9990-955e2b9f79f6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Lock "cinder-quobyte-161469ea-095f-46b4-9990-955e2b9f79f6" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[103c1021-a835-4188-80bb-f4b070229450]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:54 devstack sudo[87578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6
Apr 13 17:08:54 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:55 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964 1073741824" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:55 devstack sudo[87618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964
Apr 13 17:08:55 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:55 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6" returned: 0 in 0.553s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:55 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6
Apr 13 17:08:55 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:55 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.084s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908070b4-28dc-4c8d-ad3f-86dd6484120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d76e71-6d38-4d0c-801b-75b3183bc964', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3200efbd-ae8b-4c72-9421-d9c8ba533a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Creating offline snapshot 6b147da9-b2e1-4686-8f44-105838c69e85 of volume 72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:08:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Volume volume-85d76e71-6d38-4d0c-801b-75b3183bc964 (85d76e71-6d38-4d0c-801b-75b3183bc964): created successfully
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3200efbd-ae8b-4c72-9421-d9c8ba533a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Flow 'volume_create_manager' (e7296840-2b9e-4ff7-9cd0-11028aa178b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde34694-9c58-41cd-8538-703a93e7adf7]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-839bfde0-1a8f-4334-bd0c-ef859e78e35e tempest-VolumesTransfersV357Test-1432214158 None] Created volume successfully.
Apr 13 17:08:55 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-161469ea-095f-46b4-9990-955e2b9f79f6" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Lock "cinder-quobyte-161469ea-095f-46b4-9990-955e2b9f79f6" released by "delete_volume" :: held 1.066s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:55 devstack sudo[87626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2
Apr 13 17:08:55 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Created reservations ['dda76e08-7f74-45b3-93ed-f3a21b1dec36', 'b6012cbc-7f9e-4915-960f-915297966fa1', 'ea3ece85-d4d4-4239-8812-cc6e55e670d4', 'e69ff8cd-5a2c-4243-a2c8-90a208b1d6de'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:55 devstack sudo[87628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:55 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:56 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:56 devstack sudo[87634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 1G
Apr 13 17:08:56 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:56 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.430s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:56 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:08:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Deleted volume successfully.
Apr 13 17:08:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ddf805e-a4bb-47ee-8371-6932fc9d29ad tempest-VolumesMetadataTest-493840476 None] Lock "cinder-161469ea-095f-46b4-9990-955e2b9f79f6-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:56 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 1G" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:56 devstack sudo[87639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85
Apr 13 17:08:56 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:57 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=172,cinder:INSERT=53,cinder:UPDATE=246,cinder:DELETE=18 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:08:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a7a95f22-1582-43bf-8b1f-242c1436386e tempest-VolumesTransfersV357Test-1177193487 None] Transfer volume completed successfully.
Apr 13 17:08:57 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:57 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 is being set with open permissions: ugo+rw
Apr 13 17:08:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:57 devstack sudo[87645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85
Apr 13 17:08:57 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:58 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=187,cinder:UPDATE=189,cinder:DELETE=17,cinder:INSERT=80 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:58 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.info
Apr 13 17:08:58 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Acquiring lock "cinder-85d76e71-6d38-4d0c-801b-75b3183bc964-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-85d76e71-6d38-4d0c-801b-75b3183bc964-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Acquiring lock "cinder-quobyte-85d76e71-6d38-4d0c-801b-75b3183bc964" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-quobyte-85d76e71-6d38-4d0c-801b-75b3183bc964" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e83785-6947-4123-a501-2a09a871971e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:58 devstack sudo[87650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964
Apr 13 17:08:58 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:58 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.info" returned: 0 in 0.705s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:58 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.info is being set with open permissions: ugo+rw
Apr 13 17:08:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:58 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.info
Apr 13 17:08:58 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:59 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964" returned: 0 in 0.676s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:59 devstack sudo[87659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964
Apr 13 17:08:59 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:08:59 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.info" returned: 0 in 0.562s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.600s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-558ffd17-95f4-43c5-a14e-4e631b473bd6 tempest-CreateVolumesFromSnapshotTest-167663706 None] Create snapshot completed successfully
Apr 13 17:08:59 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-85d76e71-6d38-4d0c-801b-75b3183bc964" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-quobyte-85d76e71-6d38-4d0c-801b-75b3183bc964" released by "delete_volume" :: held 1.189s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Created reservations ['5f00a6b4-6df1-44b6-89f6-752bb999da00', 'cd83cbf4-444c-401a-8152-d3ae0d267844', 'c70375cb-038e-4c50-884f-366a5fe9b0b6', '98713093-a706-42f2-8ec5-d60d9e77a771'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:08:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:08:59 devstack sudo[87664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:08:59 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (6108afb5-2577-4e7f-bc11-6264ecf409bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32a6dcc-dacb-4fe8-a74a-77260f4b7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32a6dcc-dacb-4fe8-a74a-77260f4b7818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308209368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e559512e-03b2-4316-a517-27776d08284b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:00Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a18a6a-d0b5-44a6-a065-1626c6fab7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a18a6a-d0b5-44a6-a065-1626c6fab7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bd990f-da6b-4cfb-9b8c-f15b6398e431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58bd990f-da6b-4cfb-9b8c-f15b6398e431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e559512e-03b2-4316-a517-27776d08284b', 'volume_name': 'volume-e559512e-03b2-4316-a517-27776d08284b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6ca4ee-1029-4410-91e5-b4a1a030c5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6ca4ee-1029-4410-91e5-b4a1a030c5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e77f640-cb6d-495a-9c6b-f99521c5dc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume e559512e-03b2-4316-a517-27776d08284b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e559512e-03b2-4316-a517-27776d08284b', 'volume_size': 1}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308209368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e559512e-03b2-4316-a517-27776d08284b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:00Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Creating volume e559512e-03b2-4316-a517-27776d08284b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:00 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:00 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.614s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:00 devstack sudo[87667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b 1073741824
Apr 13 17:09:00 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Deleted volume successfully.
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b6f58726-5e78-4510-b3b6-a85ed307c318 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-85d76e71-6d38-4d0c-801b-75b3183bc964-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (a1f471fa-d0e6-4a1a-b0e2-54252b1e2b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0169a10-372b-408f-bd7d-3a1ceac20abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0169a10-372b-408f-bd7d-3a1ceac20abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266133463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d9878e-c0b6-4350-b80a-e6012eacbd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:00Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fbfea7-b4ac-404f-a379-47704a672b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0fbfea7-b4ac-404f-a379-47704a672b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b2eb52-9103-4e9a-be49-5c80dead40a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7b2eb52-9103-4e9a-be49-5c80dead40a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d9878e-c0b6-4350-b80a-e6012eacbd6e', 'volume_name': 'volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48082526-0054-4bc5-9c76-e7238167024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48082526-0054-4bc5-9c76-e7238167024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57c8f59-91ee-4a57-9e87-2f89c2f050b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume 79d9878e-c0b6-4350-b80a-e6012eacbd6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e', 'volume_size': 1}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (f14a57a3-d963-43c7-bed3-246afb32548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e3fc84-6004-4d5e-bd43-7366e00ab379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e3fc84-6004-4d5e-bd43-7366e00ab379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281915975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d35cbb-27d6-4411-bfc7-47790fab21f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b99ab3-963b-4b58-81b3-792fb42de563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b99ab3-963b-4b58-81b3-792fb42de563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a869d0-d28b-4793-a7eb-b3dbebfa6ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a869d0-d28b-4793-a7eb-b3dbebfa6ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41d35cbb-27d6-4411-bfc7-47790fab21f7', 'volume_name': 'volume-41d35cbb-27d6-4411-bfc7-47790fab21f7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a12818-7e21-4ef9-8ffb-61bbae3589a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a12818-7e21-4ef9-8ffb-61bbae3589a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35590590-b38a-4c05-866d-dc7ef68c7adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume 41d35cbb-27d6-4411-bfc7-47790fab21f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41d35cbb-27d6-4411-bfc7-47790fab21f7', 'volume_size': 1}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (0fa662a1-ae89-435b-9054-cbd3dc4d5ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148e23b3-c0b7-473c-aea6-98116d94cc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:00 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b 1073741824" returned: 0 in 0.753s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148e23b3-c0b7-473c-aea6-98116d94cc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257448589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c45faa-c744-4f20-a66e-451860bb7864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2eeab7-0baa-4b9d-8f9b-12c647b7e4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2eeab7-0baa-4b9d-8f9b-12c647b7e4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c066a2-18c6-4e79-956b-19d29cc0df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c066a2-18c6-4e79-956b-19d29cc0df4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58c45faa-c744-4f20-a66e-451860bb7864', 'volume_name': 'volume-58c45faa-c744-4f20-a66e-451860bb7864', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dfc303-27af-48b8-ae74-8852a52203a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15dfc303-27af-48b8-ae74-8852a52203a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcede59-38fd-413e-844d-12d147598ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume 58c45faa-c744-4f20-a66e-451860bb7864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58c45faa-c744-4f20-a66e-451860bb7864', 'volume_size': 1}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:01 devstack sudo[87672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b
Apr 13 17:09:01 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Flow 'volume_create_manager' (c3df2aba-83e4-4b5c-b7ef-eff7e2ce189a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066ec5fb-1a85-4b61-bbb6-72df6220f8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066ec5fb-1a85-4b61-bbb6-72df6220f8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823591803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f108bb7-95ea-48c1-bd34-975e0724edce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0ca91c281448448fb125d20f3513c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='f072665f9cf0453a95d2039e3edfff2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0083bc84-ad1f-4356-8aaf-1434198b58d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0083bc84-ad1f-4356-8aaf-1434198b58d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6822460-5075-4dfd-a7f5-b9ab77ad311e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6822460-5075-4dfd-a7f5-b9ab77ad311e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f108bb7-95ea-48c1-bd34-975e0724edce', 'volume_name': 'volume-2f108bb7-95ea-48c1-bd34-975e0724edce', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9525035-f144-4d9d-bd2b-2407a9ce4f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9525035-f144-4d9d-bd2b-2407a9ce4f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd794f4-07c4-490d-8049-c2e12a131eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Volume 2f108bb7-95ea-48c1-bd34-975e0724edce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f108bb7-95ea-48c1-bd34-975e0724edce', 'volume_size': 1}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (65bc9dab-7343-4bc3-9e5c-48c15b503739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621c76d6-f094-4dc8-8c64-0b65370f7385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (621c76d6-f094-4dc8-8c64-0b65370f7385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167834183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c650980f-f3df-4c55-aa71-0781170a4ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb6f661-8f76-456b-b386-76712bbc0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb6f661-8f76-456b-b386-76712bbc0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01050725-5333-4827-b6de-122d35f92d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01050725-5333-4827-b6de-122d35f92d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c650980f-f3df-4c55-aa71-0781170a4ec3', 'volume_name': 'volume-c650980f-f3df-4c55-aa71-0781170a4ec3', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7edc3c0-7aed-4c38-819d-b8e8b8dcff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7edc3c0-7aed-4c38-819d-b8e8b8dcff85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eab1f05-f186-4cc6-8241-ef1d71f77c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume c650980f-f3df-4c55-aa71-0781170a4ec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c650980f-f3df-4c55-aa71-0781170a4ec3', 'volume_size': 1}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:01 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266133463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d9878e-c0b6-4350-b80a-e6012eacbd6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:00Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Creating volume 79d9878e-c0b6-4350-b80a-e6012eacbd6e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:01 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e77f640-cb6d-495a-9c6b-f99521c5dc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e559512e-03b2-4316-a517-27776d08284b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3b076f-2801-416a-8115-69c366c05be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume volume-e559512e-03b2-4316-a517-27776d08284b (e559512e-03b2-4316-a517-27776d08284b): created successfully
Apr 13 17:09:01 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e 1073741824
Apr 13 17:09:01 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3b076f-2801-416a-8115-69c366c05be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (6108afb5-2577-4e7f-bc11-6264ecf409bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-440f8512-98be-4507-8a1c-ac46755c5fae tempest-CreateVolumesFromSnapshotTest-167663706 None] Created volume successfully.
Apr 13 17:09:02 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e 1073741824" returned: 0 in 0.624s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:02 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e
Apr 13 17:09:02 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:02 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281915975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41d35cbb-27d6-4411-bfc7-47790fab21f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Creating volume 41d35cbb-27d6-4411-bfc7-47790fab21f7 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:02 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57c8f59-91ee-4a57-9e87-2f89c2f050b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63523766-6a9e-4736-9865-478d6a7aee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e (79d9878e-c0b6-4350-b80a-e6012eacbd6e): created successfully
Apr 13 17:09:02 devstack sudo[87684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7 1073741824
Apr 13 17:09:02 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63523766-6a9e-4736-9865-478d6a7aee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (a1f471fa-d0e6-4a1a-b0e2-54252b1e2b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5f11356c-b6d5-4c8b-93ab-db1326d3056f tempest-CreateVolumesFromSnapshotTest-167663706 None] Created volume successfully.
Apr 13 17:09:03 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7 1073741824" returned: 0 in 0.636s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:03 devstack sudo[87689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7
Apr 13 17:09:03 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:04 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7" returned: 0 in 0.623s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-257448589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58c45faa-c744-4f20-a66e-451860bb7864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Creating volume 58c45faa-c744-4f20-a66e-451860bb7864 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:04 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35590590-b38a-4c05-866d-dc7ef68c7adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41d35cbb-27d6-4411-bfc7-47790fab21f7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a44f9c-add4-44f9-9be6-63a8b429afcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:04 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume volume-41d35cbb-27d6-4411-bfc7-47790fab21f7 (41d35cbb-27d6-4411-bfc7-47790fab21f7): created successfully
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a44f9c-add4-44f9-9be6-63a8b429afcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:04 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864 1073741824
Apr 13 17:09:04 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (f14a57a3-d963-43c7-bed3-246afb32548a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:04 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e1920f0c-bd1e-4bcc-a2a4-24cd97e48b7d tempest-CreateVolumesFromSnapshotTest-167663706 None] Created volume successfully.
Apr 13 17:09:04 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864 1073741824" returned: 0 in 0.733s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:05 devstack sudo[87697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864
Apr 13 17:09:05 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:05 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864" returned: 0 in 0.550s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.198s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823591803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f108bb7-95ea-48c1-bd34-975e0724edce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0ca91c281448448fb125d20f3513c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='f072665f9cf0453a95d2039e3edfff2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Creating volume 2f108bb7-95ea-48c1-bd34-975e0724edce {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:05 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcede59-38fd-413e-844d-12d147598ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58c45faa-c744-4f20-a66e-451860bb7864', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39d761e-d451-4919-a29b-1ef82ed51b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:05 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume volume-58c45faa-c744-4f20-a66e-451860bb7864 (58c45faa-c744-4f20-a66e-451860bb7864): created successfully
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39d761e-d451-4919-a29b-1ef82ed51b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (0fa662a1-ae89-435b-9054-cbd3dc4d5ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:05 devstack sudo[87700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce 1073741824
Apr 13 17:09:05 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5ae8668b-9f51-4402-b94c-a10ba5324141 tempest-CreateVolumesFromSnapshotTest-167663706 None] Created volume successfully.
Apr 13 17:09:06 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce 1073741824" returned: 0 in 0.597s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:06 devstack sudo[87705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce
Apr 13 17:09:06 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:06 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce" returned: 0 in 0.686s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.445s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1167834183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c650980f-f3df-4c55-aa71-0781170a4ec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32a3042a612a4a3ba46be41471af41c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:01Z,use_quota=True,user_id='e5c04e7efd824eb5a03d02374ead61d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Creating volume c650980f-f3df-4c55-aa71-0781170a4ec3 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:06 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd794f4-07c4-490d-8049-c2e12a131eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f108bb7-95ea-48c1-bd34-975e0724edce', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc998f32-867c-493c-af47-4ae9a809fa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:06 devstack sudo[87708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3 1073741824
Apr 13 17:09:06 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:06 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Volume volume-2f108bb7-95ea-48c1-bd34-975e0724edce (2f108bb7-95ea-48c1-bd34-975e0724edce): created successfully
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc998f32-867c-493c-af47-4ae9a809fa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Flow 'volume_create_manager' (c3df2aba-83e4-4b5c-b7ef-eff7e2ce189a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-43819d59-7905-4d60-b08c-4a470024b8e7 tempest-VolumesTransfersV357Test-1432214158 None] Created volume successfully.
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Flow 'volume_create_manager' (8fada6eb-6e4c-438a-a2af-908283c5920d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefcb634-d8b2-460b-8df9-e6416ad205d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefcb634-d8b2-460b-8df9-e6416ad205d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915398021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d9cea4-cfbc-4283-90f2-764889042aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af51d3ad74648f3a6865d330ad42f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:07Z,use_quota=True,user_id='1284eb594dfa4fc491b5873cf39117b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c45f88-3943-456e-970d-c7c18bdf4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c45f88-3943-456e-970d-c7c18bdf4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e14c4e2-4c4f-4c8a-b33e-fa3b314d9dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e14c4e2-4c4f-4c8a-b33e-fa3b314d9dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83d9cea4-cfbc-4283-90f2-764889042aa6', 'volume_name': 'volume-83d9cea4-cfbc-4283-90f2-764889042aa6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee8ee9e-e9ff-482d-8551-fbb2b48ab496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee8ee9e-e9ff-482d-8551-fbb2b48ab496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb548097-0c4c-4a85-9a92-56613db47005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:07 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Volume 83d9cea4-cfbc-4283-90f2-764889042aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83d9cea4-cfbc-4283-90f2-764889042aa6', 'volume_size': 1}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:07 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3 1073741824" returned: 0 in 0.670s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:07 devstack sudo[87713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3
Apr 13 17:09:07 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Acquiring lock "cinder-2f108bb7-95ea-48c1-bd34-975e0724edce-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-2f108bb7-95ea-48c1-bd34-975e0724edce-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Acquiring lock "cinder-quobyte-2f108bb7-95ea-48c1-bd34-975e0724edce" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-quobyte-2f108bb7-95ea-48c1-bd34-975e0724edce" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d0aa14-09f0-4698-9c6b-ec633129d41d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:08 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce
Apr 13 17:09:08 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:08 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-915398021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83d9cea4-cfbc-4283-90f2-764889042aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af51d3ad74648f3a6865d330ad42f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:07Z,use_quota=True,user_id='1284eb594dfa4fc491b5873cf39117b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Creating volume 83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:08 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:08 devstack sudo[87718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 1073741824
Apr 13 17:09:08 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eab1f05-f186-4cc6-8241-ef1d71f77c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c650980f-f3df-4c55-aa71-0781170a4ec3', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea151a4-3b2b-461c-b03d-8b9b4dd2af17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Volume volume-c650980f-f3df-4c55-aa71-0781170a4ec3 (c650980f-f3df-4c55-aa71-0781170a4ec3): created successfully
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea151a4-3b2b-461c-b03d-8b9b4dd2af17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Flow 'volume_create_manager' (65bc9dab-7343-4bc3-9e5c-48c15b503739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-26f7cea9-d617-4263-aa10-f45eccbd2b86 tempest-CreateVolumesFromSnapshotTest-167663706 None] Created volume successfully.
Apr 13 17:09:08 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce" returned: 0 in 0.561s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:08 devstack sudo[87723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce
Apr 13 17:09:08 devstack sudo[87723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:08 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 1073741824" returned: 0 in 0.634s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:08 devstack sudo[87728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:09:08 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:08 devstack sudo[87723]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2f108bb7-95ea-48c1-bd34-975e0724edce" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-quobyte-2f108bb7-95ea-48c1-bd34-975e0724edce" released by "delete_volume" :: held 1.100s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Created reservations ['0ec8d317-6579-4772-8fae-1612011bee92', '762a7205-009d-4ff4-abb2-2dce114e0d9f', '9457c9fa-db77-45b4-88e9-4b20e7cc4aca', '1fac0993-a5e9-4a9c-bbba-8e409d206964'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-c650980f-f3df-4c55-aa71-0781170a4ec3-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:09 devstack sudo[87732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:09 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-c650980f-f3df-4c55-aa71-0781170a4ec3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-c650980f-f3df-4c55-aa71-0781170a4ec3" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-c650980f-f3df-4c55-aa71-0781170a4ec3" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b71f63-4b4c-45f8-b502-83e32bdbb8d0]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:09 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb548097-0c4c-4a85-9a92-56613db47005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83d9cea4-cfbc-4283-90f2-764889042aa6', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697bf986-522a-40b7-b66d-3750330776c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Volume volume-83d9cea4-cfbc-4283-90f2-764889042aa6 (83d9cea4-cfbc-4283-90f2-764889042aa6): created successfully
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697bf986-522a-40b7-b66d-3750330776c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Flow 'volume_create_manager' (8fada6eb-6e4c-438a-a2af-908283c5920d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-97d5cdd3-b3f7-4e0c-96c1-4bb889e34520 tempest-VolumesActionsTest-1919306332 None] Created volume successfully.
Apr 13 17:09:09 devstack sudo[87735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3
Apr 13 17:09:09 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b5cb2cb9-4a91-4ac8-b792-4481092f7d4a tempest-GroupsTest-13234762 None] Group tempest-Group1-283999113: creating
Apr 13 17:09:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b5cb2cb9-4a91-4ac8-b792-4481092f7d4a tempest-GroupsTest-13234762 None] Group tempest-Group1-283999113: created successfully
Apr 13 17:09:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b5cb2cb9-4a91-4ac8-b792-4481092f7d4a tempest-GroupsTest-13234762 None] Create group completed successfully.
Apr 13 17:09:09 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.592s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Deleted volume successfully.
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2f6ad6fe-a0f2-400d-ae2c-dcd0ffa726b2 tempest-VolumesTransfersV357Test-676149906 None] Lock "cinder-2f108bb7-95ea-48c1-bd34-975e0724edce-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:09 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3" returned: 0 in 0.648s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:09 devstack sudo[87741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3
Apr 13 17:09:09 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:10 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-c650980f-f3df-4c55-aa71-0781170a4ec3" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-c650980f-f3df-4c55-aa71-0781170a4ec3" released by "delete_volume" :: held 1.193s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Created reservations ['abfe2445-550e-42c5-8a59-86e8cf28a7d6', '78872577-ad31-484b-b8c9-34f032d8c7d9', '6affb927-20d6-45f0-872f-37ce743c26e5', '82b4337d-5b88-4621-9626-256d17d5d35c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:10 devstack sudo[87747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:10 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7cad3605-2d46-417a-87d2-5040155cc1ae tempest-GroupsTest-13234762 None] Group tempest-Group2-1796403848: creating
Apr 13 17:09:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7cad3605-2d46-417a-87d2-5040155cc1ae tempest-GroupsTest-13234762 None] Group tempest-Group2-1796403848: created successfully
Apr 13 17:09:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7cad3605-2d46-417a-87d2-5040155cc1ae tempest-GroupsTest-13234762 None] Create group completed successfully.
Apr 13 17:09:11 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Deleted volume successfully.
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ea7e1ef7-6a0f-49ac-b950-77fda5803985 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-c650980f-f3df-4c55-aa71-0781170a4ec3-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-58c45faa-c744-4f20-a66e-451860bb7864-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-58c45faa-c744-4f20-a66e-451860bb7864-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-58c45faa-c744-4f20-a66e-451860bb7864" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-58c45faa-c744-4f20-a66e-451860bb7864" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b2472b-0675-4a29-a50e-19bf7b5fed32]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:11 devstack sudo[87751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864
Apr 13 17:09:11 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:11 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864" returned: 0 in 0.586s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:12 devstack sudo[87756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864
Apr 13 17:09:12 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Flow 'volume_create_manager' (6205fb6b-e5d7-41f8-bb65-f7c119131b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9405afb-5019-461d-a7a6-cb7407670057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9405afb-5019-461d-a7a6-cb7407670057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027886592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1a3989e-b112-4e1e-b9ce-5eefa905c6bd,host='devstack@QuobyteHD#QuobyteHD',id=8b914a92-925a-47e3-b89f-3c34720085f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6050986dd24a2db337da3c03bf666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:12Z,use_quota=True,user_id='c9f149540cd64c17acc230ab6372c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17867d1-4661-424d-acd1-5373fe48d1e4),volume_type_id=a17867d1-4661-424d-acd1-5373fe48d1e4)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6cbc78-aa91-4550-84fc-23ad2802165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6cbc78-aa91-4550-84fc-23ad2802165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c1688f-664a-47de-aa60-1f92b31ed3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c1688f-664a-47de-aa60-1f92b31ed3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b914a92-925a-47e3-b89f-3c34720085f7', 'volume_name': 'volume-8b914a92-925a-47e3-b89f-3c34720085f7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3163156f-8ce0-4856-8e52-060e69b54b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3163156f-8ce0-4856-8e52-060e69b54b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898c193d-1867-4e2c-9245-7e39f4fde5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Volume 8b914a92-925a-47e3-b89f-3c34720085f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b914a92-925a-47e3-b89f-3c34720085f7', 'volume_size': 1}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d1a3989e-b112-4e1e-b9ce-5eefa905c6bd,created_at=2026-04-13T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1027886592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d1a3989e-b112-4e1e-b9ce-5eefa905c6bd,host='devstack@QuobyteHD#QuobyteHD',id=8b914a92-925a-47e3-b89f-3c34720085f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6050986dd24a2db337da3c03bf666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:12Z,use_quota=True,user_id='c9f149540cd64c17acc230ab6372c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a17867d1-4661-424d-acd1-5373fe48d1e4),volume_type_id=a17867d1-4661-424d-acd1-5373fe48d1e4)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Creating volume 8b914a92-925a-47e3-b89f-3c34720085f7 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:12 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:12 devstack sudo[87758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7 1073741824
Apr 13 17:09:12 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:12 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58c45faa-c744-4f20-a66e-451860bb7864" returned: 0 in 0.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:12 devstack sudo[87763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:12 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-58c45faa-c744-4f20-a66e-451860bb7864" released by "delete_volume" :: held 1.159s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Created reservations ['733ef650-3631-4f19-a5e5-25050b6cd91b', '8b72ca16-c21d-4616-ba31-8a380ee460c5', 'f6db1dc7-fb3c-4578-898d-5665a2eb3583', 'c7128091-25b3-478e-9f3c-778db10ae169'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:12 devstack sudo[87766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:12 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:12 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7 1073741824" returned: 0 in 0.588s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:12 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7
Apr 13 17:09:12 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:13 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Deleted volume successfully.
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-40349052-2075-4f3b-9347-5a54dbb8870d tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-58c45faa-c744-4f20-a66e-451860bb7864-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:13 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.721s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:13 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7" returned: 0 in 0.615s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (898c193d-1867-4e2c-9245-7e39f4fde5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b914a92-925a-47e3-b89f-3c34720085f7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b8f8e7-85f1-40b4-bd3d-e5cb8c581ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Volume volume-8b914a92-925a-47e3-b89f-3c34720085f7 (8b914a92-925a-47e3-b89f-3c34720085f7): created successfully
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b8f8e7-85f1-40b4-bd3d-e5cb8c581ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Flow 'volume_create_manager' (6205fb6b-e5d7-41f8-bb65-f7c119131b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3548e7e7-0a06-4836-9125-072facb9a528 tempest-GroupsTest-13234762 None] Created volume successfully.
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Flow 'volume_create_manager' (ca583b46-7110-46b6-9ed4-979922c55323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ebe451-184e-4ddd-b504-86e7f808d285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-41d35cbb-27d6-4411-bfc7-47790fab21f7-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ebe451-184e-4ddd-b504-86e7f808d285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-929262742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c6aec6-254c-46b8-b526-19a0ebbdb21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f7aa1ff8634f748f24eecb924d0a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:13Z,use_quota=True,user_id='3cd2e507ca644b4597ff9b00c39b3a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f5f489-f3cc-4727-98fe-9f7df80716bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f5f489-f3cc-4727-98fe-9f7df80716bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2833b6-faf7-403b-aff9-8b09190d2619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.image.glance [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Creating Keystone auth plugin from conf {{(pid=82641) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-41d35cbb-27d6-4411-bfc7-47790fab21f7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-41d35cbb-27d6-4411-bfc7-47790fab21f7" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-41d35cbb-27d6-4411-bfc7-47790fab21f7" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e76db82-f08e-48ae-9869-e3b8d0629095]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:13 devstack sudo[87773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7
Apr 13 17:09:13 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d2833b6-faf7-403b-aff9-8b09190d2619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9c6aec6-254c-46b8-b526-19a0ebbdb21f', 'volume_name': 'volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd23502e0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e78f70-e754-462e-ad28-210f3a6188ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e78f70-e754-462e-ad28-210f3a6188ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5c29bb-cb25-4d0f-94c8-c83bd7220b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Volume f9c6aec6-254c-46b8-b526-19a0ebbdb21f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd23502e0>}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Trying to clone f9c6aec6-254c-46b8-b526-19a0ebbdb21f from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]). {{(pid=82641) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 13 17:09:13 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Image download 20.69 MB at 20.69 MB/s
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc5ae6a-863a-42e2-b374-26a11a76178b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:14 devstack sudo[87776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD
Apr 13 17:09:14 devstack sudo[87776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:14 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7" returned: 0 in 0.610s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:14 devstack sudo[87781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7
Apr 13 17:09:14 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:14 devstack sudo[87776]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD" returned: 0 in 0.601s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 is fetched for user 3cd2e507ca644b4597ff9b00c39b3a89. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d12a36b-4bc5-45fb-932c-1a2a83c28b87]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Acquiring lock "cinder-quobyte-8b914a92-925a-47e3-b89f-3c34720085f7" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:14 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD
Apr 13 17:09:14 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Lock "cinder-quobyte-8b914a92-925a-47e3-b89f-3c34720085f7" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8facd5e9-4ade-4908-b7da-d313f99e6385]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:14 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-41d35cbb-27d6-4411-bfc7-47790fab21f7" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-41d35cbb-27d6-4411-bfc7-47790fab21f7" released by "delete_volume" :: held 1.143s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Created reservations ['247e5e61-3334-468d-88e7-7d5c243c4ada', '33bf8346-d88b-4013-9f59-3bab351b9296', '039c9033-3cd1-4b9e-a045-b9a0c5b1b173', '9ff049d3-fae1-414d-bc81-ae983d0053e5'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:14 devstack sudo[87789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7
Apr 13 17:09:14 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:14 devstack sudo[87791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:14 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:15 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-929262742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c6aec6-254c-46b8-b526-19a0ebbdb21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f7aa1ff8634f748f24eecb924d0a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:13Z,use_quota=True,user_id='3cd2e507ca644b4597ff9b00c39b3a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Creating volume f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:15 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:15 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 1073741824
Apr 13 17:09:15 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:15 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.515s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Deleted volume successfully.
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-90722697-5be5-4d11-8204-42a8857db04a tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-41d35cbb-27d6-4411-bfc7-47790fab21f7-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:15 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7" returned: 0 in 0.691s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:15 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7
Apr 13 17:09:15 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-79d9878e-c0b6-4350-b80a-e6012eacbd6e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-79d9878e-c0b6-4350-b80a-e6012eacbd6e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-79d9878e-c0b6-4350-b80a-e6012eacbd6e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-79d9878e-c0b6-4350-b80a-e6012eacbd6e" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2215e165-d3d9-4d75-9f92-3efbeae36845]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:15 devstack sudo[87807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e
Apr 13 17:09:15 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:15 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8b914a92-925a-47e3-b89f-3c34720085f7" returned: 0 in 0.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Lock "cinder-quobyte-8b914a92-925a-47e3-b89f-3c34720085f7" released by "delete_volume" :: held 1.266s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:15 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 1073741824" returned: 0 in 0.789s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:16 devstack sudo[87810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:16 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Created reservations ['0c72c1c1-067b-45e1-9176-a2dcd7486709'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:16 devstack cinder-volume[82641]: WARNING cinder.quota [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1478255944 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1478255944, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:09:16 devstack cinder-volume[82641]: WARNING cinder.quota [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1478255944 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1478255944, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Created reservations ['26705e9e-3372-4142-8395-4d33329b07b3', '57199c5c-106d-4a4f-a6b9-52d098299745', '6ca52711-c363-41e2-87c5-02b3a71bd254', '4dc6a9c4-2a45-47cf-925c-6c84a5ca4a17'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:16 devstack sudo[87813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:16 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:16 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e" returned: 0 in 0.694s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:16 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e
Apr 13 17:09:16 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:16 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 0 in 0.619s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Attempting download of 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume f9c6aec6-254c-46b8-b526-19a0ebbdb21f. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e72ac-b261-4449-9dd3-c40291c7a20c]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_b72kai_2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:16 devstack sudo[87822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_b72kai_2
Apr 13 17:09:16 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:16 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2883af80-1926-4ae5-a8aa-ce90819248ec tempest-GroupsTest-13234762 None] Delete group completed successfully.
Apr 13 17:09:17 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-79d9878e-c0b6-4350-b80a-e6012eacbd6e" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Created reservations ['c22a5ca9-5f1f-4a41-b8af-b77118c00190'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-79d9878e-c0b6-4350-b80a-e6012eacbd6e" released by "delete_volume" :: held 1.243s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:17 devstack sudo[87830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:17 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Created reservations ['aef9e0d2-f492-47d8-be9c-01c0c8be7f41', '40f5c902-e758-4c79-84f6-cc62f0e77b42', '90d203b1-a625-41bf-b2a8-17e0372f5c75', '5c503537-7682-4f36-9921-0715c4fbffb0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:17 devstack sudo[87840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:17 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:17 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_b72kai_2" returned: 0 in 0.562s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_b72kai_2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:17 devstack sudo[87845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_b72kai_2
Apr 13 17:09:17 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:17 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a4547a5b-e4e0-47e4-8bc0-efd763b00cde tempest-GroupsTest-13234762 None] Delete group completed successfully.
Apr 13 17:09:17 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.501s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Deleted volume successfully.
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4af89d41-55af-47a0-99bd-58dcc08be504 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-79d9878e-c0b6-4350-b80a-e6012eacbd6e-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:17 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_b72kai_2" returned: 1 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_b72kai_2' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbff2dc-ba1a-429b-b571-62fe2a609fc1]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:17 devstack sudo[87853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD
Apr 13 17:09:17 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-e559512e-03b2-4316-a517-27776d08284b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-e559512e-03b2-4316-a517-27776d08284b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-e559512e-03b2-4316-a517-27776d08284b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-e559512e-03b2-4316-a517-27776d08284b" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6734a-884e-46ba-8a24-6b8f9a4dd4a2]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:18 devstack sudo[87855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b
Apr 13 17:09:18 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:18 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:18 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 was qcow2, converting to raw {{(pid=82641) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 13 17:09:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:18 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:18 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d439e719-6178-4a5b-82c7-68c6947366a7 tempest-GroupsTest-13234762 None] Group tempest-GroupsTest-Group-1066150461: creating
Apr 13 17:09:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d439e719-6178-4a5b-82c7-68c6947366a7 tempest-GroupsTest-13234762 None] Group tempest-GroupsTest-Group-1066150461: created successfully
Apr 13 17:09:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d439e719-6178-4a5b-82c7-68c6947366a7 tempest-GroupsTest-13234762 None] Create group completed successfully.
Apr 13 17:09:18 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b" returned: 0 in 0.650s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:18 devstack sudo[87865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b
Apr 13 17:09:18 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:19 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e559512e-03b2-4316-a517-27776d08284b" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-e559512e-03b2-4316-a517-27776d08284b" released by "delete_volume" :: held 1.215s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Created reservations ['d440a82b-a1dd-4d6c-b72b-9f258d9385d1', '1c996ce3-62d4-4097-a510-102c405029aa', '8e6b85a5-68ad-4833-b22c-234290533a9a', '301f7c7d-6621-48c2-b1cf-1cd4fd274486'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:19 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:19 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:19 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 0 in 1.062s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6660bc04-a3d6-44d5-a19c-5d558fe1e4a9_nstp6ui4devstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:09:19 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Converted 112.00 MB image at 105.32 MB/s
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:19 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 1G
Apr 13 17:09:19 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:19 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.486s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Deleted volume successfully.
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9927a02a-ff48-4399-9e0f-2d6637f086da tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-e559512e-03b2-4316-a517-27776d08284b-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Flow 'volume_create_manager' (7b64c111-73f1-4cd0-b043-c028cc155f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:19 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b93939-0ac5-493e-8a5e-0a43c5cc2830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b93939-0ac5-493e-8a5e-0a43c5cc2830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2024334878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29668e0b-003d-40b1-a173-ce970c6b8484,host='devstack@QuobyteHD#QuobyteHD',id=cfc2f0ab-8341-4445-b658-91cd8a63cc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6050986dd24a2db337da3c03bf666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:20Z,use_quota=True,user_id='c9f149540cd64c17acc230ab6372c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c88105a-ba5c-42ae-95a1-d685789bd9d4),volume_type_id=2c88105a-ba5c-42ae-95a1-d685789bd9d4)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56dca674-c69f-48ab-827f-29d6a3cf1ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56dca674-c69f-48ab-827f-29d6a3cf1ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd28b67-3e68-4741-8c3e-0fb2042575ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd28b67-3e68-4741-8c3e-0fb2042575ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc2f0ab-8341-4445-b658-91cd8a63cc32', 'volume_name': 'volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f37321-392c-46f8-916d-0f8347340ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f37321-392c-46f8-916d-0f8347340ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bc05c3-bf55-4baf-86f0-3de0e43572d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:19 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Volume cfc2f0ab-8341-4445-b658-91cd8a63cc32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32', 'volume_size': 1}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=29668e0b-003d-40b1-a173-ce970c6b8484,created_at=2026-04-13T15:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2024334878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29668e0b-003d-40b1-a173-ce970c6b8484,host='devstack@QuobyteHD#QuobyteHD',id=cfc2f0ab-8341-4445-b658-91cd8a63cc32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6050986dd24a2db337da3c03bf666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:20Z,use_quota=True,user_id='c9f149540cd64c17acc230ab6372c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c88105a-ba5c-42ae-95a1-d685789bd9d4),volume_type_id=2c88105a-ba5c-42ae-95a1-d685789bd9d4)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Creating volume cfc2f0ab-8341-4445-b658-91cd8a63cc32 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:19 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 1G" returned: 0 in 0.643s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:20 devstack sudo[87895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32 1073741824
Apr 13 17:09:20 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df234b-54a3-4629-a48c-bccd14da01b4]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:20 devstack sudo[87897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:20 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-6b147da9-b2e1-4686-8f44-105838c69e85-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-6b147da9-b2e1-4686-8f44-105838c69e85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-72333508-62d2-4c33-8fe7-2e78adf2cab2" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-72333508-62d2-4c33-8fe7-2e78adf2cab2" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-6b147da9-b2e1-4686-8f44-105838c69e85" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-6b147da9-b2e1-4686-8f44-105838c69e85" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Deleting offline snapshot 6b147da9-b2e1-4686-8f44-105838c69e85 of volume 72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] snapshot_file for this snap is: volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fd8e6a-403a-4b7e-a139-327662268adc]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:20 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85
Apr 13 17:09:20 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:20 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32 1073741824" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:20 devstack sudo[87906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32
Apr 13 17:09:20 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:20 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:20 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:20 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:20 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72333508-62d2-4c33-8fe7-2e78adf2cab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba2a34b-b5fe-4a67-9238-f01626554af6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:20 devstack sudo[87913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2
Apr 13 17:09:20 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:20 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6bc05c3-bf55-4baf-86f0-3de0e43572d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651075eb-2fe9-4c50-b39e-f993f8c813e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Volume volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32 (cfc2f0ab-8341-4445-b658-91cd8a63cc32): created successfully
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651075eb-2fe9-4c50-b39e-f993f8c813e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Flow 'volume_create_manager' (7b64c111-73f1-4cd0-b043-c028cc155f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-34be9f7d-1c6b-487d-a5f8-4bfd496ed1d2 tempest-GroupsTest-13234762 None] Created volume successfully.
Apr 13 17:09:21 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 1 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Downloaded image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}])) to volume f9c6aec6-254c-46b8-b526-19a0ebbdb21f successfully. {{(pid=82641) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Temporary image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 for user 3cd2e507ca644b4597ff9b00c39b3a89 is deleted. {{(pid=82641) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.volume_utils [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Marking volume f9c6aec6-254c-46b8-b526-19a0ebbdb21f as bootable. {{(pid=82641) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Copying metadata from image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 to f9c6aec6-254c-46b8-b526-19a0ebbdb21f. {{(pid=82641) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Creating volume glance metadata for volume f9c6aec6-254c-46b8-b526-19a0ebbdb21f backed by image 6660bc04-a3d6-44d5-a19c-5d558fe1e4a9 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82641) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5c29bb-cb25-4d0f-94c8-c83bd7220b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f', 'volume_size': 1, 'image_id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a378f09f9a5c4583a2d8eaffea209cf4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6660bc04-a3d6-44d5-a19c-5d558fe1e4a9', 'created_at': datetime.datetime(2026, 4, 13, 15, 0, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 15, 0, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6660bc04-a3d6-44d5-a19c-5d558fe1e4a9/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6fd23502e0>}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae63a381-d353-4a23-a996-0eb27c307795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Volume volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f (f9c6aec6-254c-46b8-b526-19a0ebbdb21f): created successfully
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae63a381-d353-4a23-a996-0eb27c307795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Flow 'volume_create_manager' (ca583b46-7110-46b6-9ed4-979922c55323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-66ef59f9-7204-4c9c-83b5-733eaf54bb28 tempest-VolumesExtendTest-1202475663 None] Created volume successfully.
Apr 13 17:09:21 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2" returned: 0 in 0.530s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:21 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85
Apr 13 17:09:21 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:21 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85" returned: 0 in 0.575s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:21 devstack sudo[87954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85
Apr 13 17:09:21 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0983f268-3010-44f4-be75-525058fda2e4]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:22 devstack sudo[87957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:22 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:22 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2.6b147da9-b2e1-4686-8f44-105838c69e85" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-6b147da9-b2e1-4686-8f44-105838c69e85" released by "_delete_snapshot" :: held 2.259s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-72333508-62d2-4c33-8fe7-2e78adf2cab2" released by "delete_snapshot" :: held 2.270s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Created reservations ['1e4f8af7-43ab-4b2c-ba66-b02ed247ed50', '613e3195-e9dc-4f76-9956-7e1ba4af20b9', '046a77be-f1b9-4cbd-a76d-0728e65b16f5', '869759d3-1e3c-4ba0-bfc8-7dec5c7c7733'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Flow 'volume_create_manager' (1e9e6527-791e-4d6a-ad90-93de08045b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250de012-3094-4f82-9f1b-ec669061a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250de012-3094-4f82-9f1b-ec669061a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476522567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29668e0b-003d-40b1-a173-ce970c6b8484,host='devstack@QuobyteHD#QuobyteHD',id=9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6050986dd24a2db337da3c03bf666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:23Z,use_quota=True,user_id='c9f149540cd64c17acc230ab6372c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c88105a-ba5c-42ae-95a1-d685789bd9d4),volume_type_id=2c88105a-ba5c-42ae-95a1-d685789bd9d4)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e0e6ea-c628-4e0d-aaca-f0d1fdad4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e0e6ea-c628-4e0d-aaca-f0d1fdad4d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0a5606-779f-4ed2-85b0-7b02786d0970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0a5606-779f-4ed2-85b0-7b02786d0970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d', 'volume_name': 'volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f753afba-72ea-49d1-a522-ec792b513289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f753afba-72ea-49d1-a522-ec792b513289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab6ba47-64c0-4b3a-abcb-b810470650de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Volume 9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d', 'volume_size': 1}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Delete snapshot completed successfully.
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-070c8034-6aed-4592-8e83-c81c92805175 tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-6b147da9-b2e1-4686-8f44-105838c69e85-delete_snapshot" released by "delete_snapshot" :: held 2.596s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:22 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 0 in 0.701s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:22 devstack sudo[87962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:22 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:23 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 1 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 2G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f 2G" returned: 0 in 0.051s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.313s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=29668e0b-003d-40b1-a173-ce970c6b8484,created_at=2026-04-13T15:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476522567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=29668e0b-003d-40b1-a173-ce970c6b8484,host='devstack@QuobyteHD#QuobyteHD',id=9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6050986dd24a2db337da3c03bf666b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:23Z,use_quota=True,user_id='c9f149540cd64c17acc230ab6372c85b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c88105a-ba5c-42ae-95a1-d685789bd9d4),volume_type_id=2c88105a-ba5c-42ae-95a1-d685789bd9d4)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Creating volume 9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:23 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-72333508-62d2-4c33-8fe7-2e78adf2cab2-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:23 devstack sudo[87970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d 1073741824
Apr 13 17:09:23 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-72333508-62d2-4c33-8fe7-2e78adf2cab2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "cinder-quobyte-72333508-62d2-4c33-8fe7-2e78adf2cab2" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7e5f5c1c-a5f2-4a7f-95b4-1b67f4e8815d tempest-VolumesExtendTest-1202475663 None] Extend volume completed successfully.
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-72333508-62d2-4c33-8fe7-2e78adf2cab2" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e2c2c7-9d0f-41fd-8255-056e5cc4dce0]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:23 devstack sudo[87972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2
Apr 13 17:09:23 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-244a01b2-2b89-4f4f-a959-2119de1b1d98 tempest-VolumesActionsTest-1919306332 None] Acquiring lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6" by "attach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-244a01b2-2b89-4f4f-a959-2119de1b1d98 tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6" acquired by "attach_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-244a01b2-2b89-4f4f-a959-2119de1b1d98 tempest-VolumesActionsTest-1919306332 None] Attaching volume 83d9cea4-cfbc-4283-90f2-764889042aa6 to instance 216fdbd1-c1fd-41cb-bce5-1e178554f368 at mountpoint /dev/vdb on host None.
Apr 13 17:09:23 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d 1073741824" returned: 0 in 0.639s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-244a01b2-2b89-4f4f-a959-2119de1b1d98 tempest-VolumesActionsTest-1919306332 None] Attach volume completed successfully.
Apr 13 17:09:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-244a01b2-2b89-4f4f-a959-2119de1b1d98 tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6" released by "attach_volume" :: held 0.161s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:24 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d
Apr 13 17:09:24 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:24 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2" returned: 0 in 0.697s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "cinder-f9c6aec6-254c-46b8-b526-19a0ebbdb21f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-f9c6aec6-254c-46b8-b526-19a0ebbdb21f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:24 devstack sudo[87982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2
Apr 13 17:09:24 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "cinder-quobyte-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8d1c4f-9674-4a4e-868c-db6aa6711051]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3cb8fd12-e680-4c8d-bd56-40779ca77659 tempest-VolumesActionsTest-1919306332 None] Acquiring lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3cb8fd12-e680-4c8d-bd56-40779ca77659 tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3cb8fd12-e680-4c8d-bd56-40779ca77659 tempest-VolumesActionsTest-1919306332 None] Detaching volume 83d9cea4-cfbc-4283-90f2-764889042aa6 from instance 216fdbd1-c1fd-41cb-bce5-1e178554f368.
Apr 13 17:09:24 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:24 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:24 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3cb8fd12-e680-4c8d-bd56-40779ca77659 tempest-VolumesActionsTest-1919306332 None] Detach volume completed successfully.
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab6ba47-64c0-4b3a-abcb-b810470650de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9029ce3-204f-403b-83ae-2075a0b9800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Volume volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d (9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d): created successfully
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9029ce3-204f-403b-83ae-2075a0b9800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Flow 'volume_create_manager' (1e9e6527-791e-4d6a-ad90-93de08045b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3cb8fd12-e680-4c8d-bd56-40779ca77659 tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-56e89555-4cea-4430-aebf-8d8958237ede tempest-GroupsTest-13234762 None] Created volume successfully.
Apr 13 17:09:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-45b41d87-e4d1-4a0b-ae22-27b0050dd1b4 tempest-GroupsTest-13234762 None] Update group completed successfully.
Apr 13 17:09:24 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 0 in 0.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:24 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72333508-62d2-4c33-8fe7-2e78adf2cab2" returned: 0 in 0.699s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-quobyte-72333508-62d2-4c33-8fe7-2e78adf2cab2" released by "delete_volume" :: held 1.518s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Created reservations ['c9a77cbf-9643-4b81-8b6e-377443af3dc3', 'bb843f4a-f8b4-4c08-85af-08143c1e7ea7', '81d6567c-1980-4fb0-a8da-65555a26a9f3', 'cf119552-086e-4980-a5d9-d23a1e92e14d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:25 devstack sudo[87990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:25 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:25 devstack sudo[87992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:25 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:25 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 1 in 0.589s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:25 devstack sudo[87999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f
Apr 13 17:09:25 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:25 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Deleted volume successfully.
Apr 13 17:09:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1008d1ea-341b-495f-9fd1-27376ad2625b tempest-CreateVolumesFromSnapshotTest-167663706 None] Lock "cinder-72333508-62d2-4c33-8fe7-2e78adf2cab2-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:26 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" returned: 0 in 0.552s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-f9c6aec6-254c-46b8-b526-19a0ebbdb21f" released by "delete_volume" :: held 1.735s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Created reservations ['0b7d34d4-9198-4d18-af83-f5b4e55a88ab', 'ced0a9ad-7fd6-4c23-a22e-b454751c056f', '515849bd-8b6a-4f58-9024-8111eb34b695', '2d5a24d8-a199-4d21-a71e-3937e92cb49d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5ea964b7-7e68-40ac-9981-ecb461e11f04 tempest-GroupsTest-13234762 None] Update group completed successfully.
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:26 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:26 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:26 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Deleted volume successfully.
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f9a3cc41-a3e7-4f90-b585-3798a9f256d4 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-f9c6aec6-254c-46b8-b526-19a0ebbdb21f-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Flow 'volume_create_manager' (7567bd24-2f96-4aec-9035-28d4fa0989a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466f85ad-6229-4e19-86c4-698cf941df1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (466f85ad-6229-4e19-86c4-698cf941df1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1484547353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba4bf1d-0988-4e0d-9273-56a0a00acbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f7aa1ff8634f748f24eecb924d0a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:27Z,use_quota=True,user_id='3cd2e507ca644b4597ff9b00c39b3a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9755a9-f271-43fd-a1e6-a560e14cda1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9755a9-f271-43fd-a1e6-a560e14cda1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b89f91c-ddd7-49b5-86da-e20b41406d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b89f91c-ddd7-49b5-86da-e20b41406d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba4bf1d-0988-4e0d-9273-56a0a00acbe0', 'volume_name': 'volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3e360f-3c3d-47df-a57b-2bcc6e4079a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3e360f-3c3d-47df-a57b-2bcc6e4079a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14cfc72-9602-45b2-9d69-e0bcde5cd882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Volume 6ba4bf1d-0988-4e0d-9273-56a0a00acbe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0', 'volume_size': 1}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1484547353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba4bf1d-0988-4e0d-9273-56a0a00acbe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16f7aa1ff8634f748f24eecb924d0a85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:27Z,use_quota=True,user_id='3cd2e507ca644b4597ff9b00c39b3a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Creating volume 6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:26 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:27 devstack sudo[88033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 1073741824
Apr 13 17:09:27 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Acquiring lock "cinder-quobyte-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Lock "cinder-quobyte-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf1015-08af-423c-af74-de9074257b3e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:27 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 1073741824" returned: 0 in 0.629s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:27 devstack sudo[88040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0
Apr 13 17:09:27 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:27 devstack sudo[88039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d
Apr 13 17:09:27 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (2ff08b70-372b-4063-ba93-e363f5568e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678cea74-0d2f-4a23-a36f-39920db9432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678cea74-0d2f-4a23-a36f-39920db9432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519145038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a45e84-b407-49ca-939d-aa64697224dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:28Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22e7877-1629-450a-b11a-bf25a53c55e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22e7877-1629-450a-b11a-bf25a53c55e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a445fe-656d-401e-8cf7-68fddb624bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99a445fe-656d-401e-8cf7-68fddb624bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a45e84-b407-49ca-939d-aa64697224dc', 'volume_name': 'volume-51a45e84-b407-49ca-939d-aa64697224dc', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1076042-7d53-4b84-88bf-301154ce356f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1076042-7d53-4b84-88bf-301154ce356f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83dcc50-c6bd-4579-b6c6-685987928322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:27 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume 51a45e84-b407-49ca-939d-aa64697224dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a45e84-b407-49ca-939d-aa64697224dc', 'volume_size': 1}
Apr 13 17:09:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:28 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d" returned: 0 in 0.592s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:28 devstack sudo[88048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d
Apr 13 17:09:28 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:28 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" returned: 0 in 0.541s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1519145038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a45e84-b407-49ca-939d-aa64697224dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:28Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Creating volume 51a45e84-b407-49ca-939d-aa64697224dc {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:28 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14cfc72-9602-45b2-9d69-e0bcde5cd882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f343b7-fa0b-41a1-ab69-d315d7e1cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:28 devstack sudo[88050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc 1073741824
Apr 13 17:09:28 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Volume volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 (6ba4bf1d-0988-4e0d-9273-56a0a00acbe0): created successfully
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f343b7-fa0b-41a1-ab69-d315d7e1cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Flow 'volume_create_manager' (7567bd24-2f96-4aec-9035-28d4fa0989a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-941115b3-824d-441b-baf4-c258b3095631 tempest-VolumesExtendTest-1202475663 None] Created volume successfully.
Apr 13 17:09:28 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Lock "cinder-quobyte-9f860e3e-ea98-4e92-ac68-9f9a76ddbb1d" released by "delete_volume" :: held 1.062s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Acquiring lock "cinder-quobyte-cfc2f0ab-8341-4445-b658-91cd8a63cc32" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Lock "cinder-quobyte-cfc2f0ab-8341-4445-b658-91cd8a63cc32" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fa6d3a-0426-44f5-808f-c6f8ead64f02]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:28 devstack sudo[88055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32
Apr 13 17:09:28 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:28 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc 1073741824" returned: 0 in 0.620s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:28 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc
Apr 13 17:09:28 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:29 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32" returned: 0 in 0.578s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:29 devstack sudo[88064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32
Apr 13 17:09:29 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:29 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.128s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83dcc50-c6bd-4579-b6c6-685987928322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a45e84-b407-49ca-939d-aa64697224dc', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d5636f-774d-41d7-974e-a7a097bd1cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Creating offline snapshot c83e34f3-7d1d-44b6-a6da-27ef27bde308 of volume 6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:09:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume volume-51a45e84-b407-49ca-939d-aa64697224dc (51a45e84-b407-49ca-939d-aa64697224dc): created successfully
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d5636f-774d-41d7-974e-a7a097bd1cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (2ff08b70-372b-4063-ba93-e363f5568e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[05156ee7-07fe-4dc0-a0d9-38ce8ef42f9e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9fa5f778-f9a3-47d7-a75b-ca2a747f9ca7 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created volume successfully.
Apr 13 17:09:29 devstack sudo[88067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0
Apr 13 17:09:29 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:29 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-cfc2f0ab-8341-4445-b658-91cd8a63cc32" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Lock "cinder-quobyte-cfc2f0ab-8341-4445-b658-91cd8a63cc32" released by "delete_volume" :: held 1.064s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Created reservations ['dabf6d63-c5b7-453c-ad0b-f7aff152aaec'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:29 devstack cinder-volume[82641]: WARNING cinder.quota [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-416699799 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-416699799, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:09:29 devstack cinder-volume[82641]: WARNING cinder.quota [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-416699799 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-416699799, it is now deprecated. Please use the default quota class for default quota.
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Created reservations ['8aff2dee-e0e2-42bc-ae11-f45997e4f6e0', '5a9d6428-85e9-4def-92dd-2a164a66cb0e', '51a35c37-c293-4383-adfa-588ecf0b97de', 'cc67cbda-a052-4966-b53b-f493001fe38a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Created reservations ['3cc57c95-d008-4fbc-a128-1cde558ccb15', '5ce65790-def5-460d-8cb3-ea82b2c3db7b', '179ca72e-6dee-4bcb-89f9-94c9887cfb2f', 'f16bba3c-b649-4374-938a-17795b8fdd07'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:29 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:29 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 1G
Apr 13 17:09:29 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:30 devstack sudo[88075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:30 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (7796af76-5771-420e-9562-f9b220573c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69124f8f-0283-459d-b2c5-e13cb705972d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69124f8f-0283-459d-b2c5-e13cb705972d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150785323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18205da-6047-45f2-8a45-7a007b439039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:30Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6caca9-d36d-4520-89e9-7783075c0e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6caca9-d36d-4520-89e9-7783075c0e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87beeac-673f-42b5-a58c-6f8fd200e859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87beeac-673f-42b5-a58c-6f8fd200e859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18205da-6047-45f2-8a45-7a007b439039', 'volume_name': 'volume-b18205da-6047-45f2-8a45-7a007b439039', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66e5d64-82a3-4409-a659-c397faa2df52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66e5d64-82a3-4409-a659-c397faa2df52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f668a501-0a62-44d9-b1f3-d024325a82ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume b18205da-6047-45f2-8a45-7a007b439039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18205da-6047-45f2-8a45-7a007b439039', 'volume_size': 1}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (0ba4156f-bcc4-4b37-8fc7-e2675445a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1791be-0b7d-4a75-b8b1-e22c80de53db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1791be-0b7d-4a75-b8b1-e22c80de53db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-715155822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d030130-9a23-4165-90be-726a01336494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:30Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88e3690-1bcd-4214-9ac8-d3a12c23b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88e3690-1bcd-4214-9ac8-d3a12c23b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41285da-eb46-42b1-a3f1-228979958909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a41285da-eb46-42b1-a3f1-228979958909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d030130-9a23-4165-90be-726a01336494', 'volume_name': 'volume-5d030130-9a23-4165-90be-726a01336494', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee51576-9dc6-47a5-8c65-738ffadd3f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee51576-9dc6-47a5-8c65-738ffadd3f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae649ffa-e942-4354-93fa-cf6475463dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume 5d030130-9a23-4165-90be-726a01336494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d030130-9a23-4165-90be-726a01336494', 'volume_size': 1}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (077a9560-cbcc-4304-8746-82405fec264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:30 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f4d360-632c-4b8a-bc08-b53d05f565ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f4d360-632c-4b8a-bc08-b53d05f565ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2090062169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d0f758-bdaa-4e97-ab4a-db67b0006071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:30Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3668f6-99d1-4456-8ae9-d16f82e7fe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3668f6-99d1-4456-8ae9-d16f82e7fe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2176106f-6d2c-4736-85f3-f0ceeb76b686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2176106f-6d2c-4736-85f3-f0ceeb76b686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d0f758-bdaa-4e97-ab4a-db67b0006071', 'volume_name': 'volume-36d0f758-bdaa-4e97-ab4a-db67b0006071', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575e436a-a6e1-4483-8a21-187c3c1f5901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575e436a-a6e1-4483-8a21-187c3c1f5901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abc2d8-cc41-46c1-9f30-a60812347f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume 36d0f758-bdaa-4e97-ab4a-db67b0006071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d0f758-bdaa-4e97-ab4a-db67b0006071', 'volume_size': 1}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.621s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 1G" returned: 0 in 0.691s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-18a7f2b0-e5c8-41a4-85b2-6fbf7c4b2890 tempest-GroupsTest-13234762 None] Delete group completed successfully.
Apr 13 17:09:30 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308
Apr 13 17:09:30 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (f6f1f88e-3411-4842-8c9a-73ccf3b3bc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459a7254-9476-49a6-80a0-cdb62eeca334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459a7254-9476-49a6-80a0-cdb62eeca334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1649869877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7a1ed3-1f56-45d6-bf1b-27bf0f001988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:31Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b13541-7df3-45dd-b0bb-3cecbb540d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b13541-7df3-45dd-b0bb-3cecbb540d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab38dea-edfa-41b3-acab-be9476d9f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eab38dea-edfa-41b3-acab-be9476d9f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7a1ed3-1f56-45d6-bf1b-27bf0f001988', 'volume_name': 'volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a535e524-20a7-40d2-b2a4-e1d684971505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a535e524-20a7-40d2-b2a4-e1d684971505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4155b9d-17ff-4137-9d99-4132ea0cf8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume fb7a1ed3-1f56-45d6-bf1b-27bf0f001988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988', 'volume_size': 1}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (b58027f3-3e1d-4d40-afca-31089be854b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7bcfb6-c043-49a7-8d4e-acd3002ad237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7bcfb6-c043-49a7-8d4e-acd3002ad237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120374765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5316f3-e6f7-4609-8416-63ffdb20b959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:31Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99afef16-9cef-45f8-aae8-e75e057d091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99afef16-9cef-45f8-aae8-e75e057d091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa99126-5ee4-44c1-ba4d-14a7b6bc60cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa99126-5ee4-44c1-ba4d-14a7b6bc60cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5316f3-e6f7-4609-8416-63ffdb20b959', 'volume_name': 'volume-4e5316f3-e6f7-4609-8416-63ffdb20b959', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55d06ef-f483-44c3-b8ff-3be0a8db19f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55d06ef-f483-44c3-b8ff-3be0a8db19f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca245f1-18d0-463d-854d-1509cf33432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:31 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume 4e5316f3-e6f7-4609-8416-63ffdb20b959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5316f3-e6f7-4609-8416-63ffdb20b959', 'volume_size': 1}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:31 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308" returned: 0 in 0.546s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:31 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 is being set with open permissions: ugo+rw
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:31 devstack sudo[88086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308
Apr 13 17:09:31 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:31 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:31 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.info
Apr 13 17:09:31 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:32 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.info" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:32 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.info is being set with open permissions: ugo+rw
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:32 devstack sudo[88092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.info
Apr 13 17:09:32 devstack sudo[88092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:32 devstack sudo[88092]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.info" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.340s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.469s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150785323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18205da-6047-45f2-8a45-7a007b439039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:30Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Creating volume b18205da-6047-45f2-8a45-7a007b439039 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:32 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:32 devstack sudo[88095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039 1073741824
Apr 13 17:09:32 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-76a4bc11-064e-4e23-b398-ce5418ae86a1 tempest-VolumesExtendTest-1202475663 None] Create snapshot completed successfully
Apr 13 17:09:33 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039 1073741824" returned: 0 in 0.709s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:33 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039
Apr 13 17:09:33 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:33 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.553s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-715155822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d030130-9a23-4165-90be-726a01336494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:30Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Creating volume 5d030130-9a23-4165-90be-726a01336494 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:33 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f668a501-0a62-44d9-b1f3-d024325a82ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18205da-6047-45f2-8a45-7a007b439039', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e3142d-65ee-477e-b341-b6df8f56b688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:33 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494 1073741824
Apr 13 17:09:33 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume volume-b18205da-6047-45f2-8a45-7a007b439039 (b18205da-6047-45f2-8a45-7a007b439039): created successfully
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e3142d-65ee-477e-b341-b6df8f56b688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (7796af76-5771-420e-9562-f9b220573c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bf7d050b-d8ae-44f8-a403-4477cacad444 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created volume successfully.
Apr 13 17:09:34 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494 1073741824" returned: 0 in 0.644s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:34 devstack sudo[88112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494
Apr 13 17:09:34 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:35 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.463s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2090062169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d0f758-bdaa-4e97-ab4a-db67b0006071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:30Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Creating volume 36d0f758-bdaa-4e97-ab4a-db67b0006071 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:35 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae649ffa-e942-4354-93fa-cf6475463dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d030130-9a23-4165-90be-726a01336494', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:35 devstack sudo[88115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071 1073741824
Apr 13 17:09:35 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90208131-6a29-42d2-9670-12b064e9118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:35 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume volume-5d030130-9a23-4165-90be-726a01336494 (5d030130-9a23-4165-90be-726a01336494): created successfully
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90208131-6a29-42d2-9670-12b064e9118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (0ba4156f-bcc4-4b37-8fc7-e2675445a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cfac3846-5e3b-4361-96dc-4c5878efba8a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created volume successfully.
Apr 13 17:09:35 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071 1073741824" returned: 0 in 0.613s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:35 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071
Apr 13 17:09:35 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:36 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.358s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1649869877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7a1ed3-1f56-45d6-bf1b-27bf0f001988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:31Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Creating volume fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:36 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1abc2d8-cc41-46c1-9f30-a60812347f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d0f758-bdaa-4e97-ab4a-db67b0006071', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202bcfa2-1218-4104-91b8-9f4fa4cc28f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:36 devstack sudo[88123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 1073741824
Apr 13 17:09:36 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume volume-36d0f758-bdaa-4e97-ab4a-db67b0006071 (36d0f758-bdaa-4e97-ab4a-db67b0006071): created successfully
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202bcfa2-1218-4104-91b8-9f4fa4cc28f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (077a9560-cbcc-4304-8746-82405fec264f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d9237b6d-c4c3-49f0-bf92-b5a413ef9ffe tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created volume successfully.
Apr 13 17:09:36 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 1073741824" returned: 0 in 0.663s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:36 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988
Apr 13 17:09:36 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:37 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.300s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120374765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5316f3-e6f7-4609-8416-63ffdb20b959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21b7e2f38fd643aa97fbf36c2badaf1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:31Z,use_quota=True,user_id='678edc7171d440c1aec23730196ca8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Creating volume 4e5316f3-e6f7-4609-8416-63ffdb20b959 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:37 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4155b9d-17ff-4137-9d99-4132ea0cf8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0abd1e-6dd0-4402-be60-052e09d9af9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 (fb7a1ed3-1f56-45d6-bf1b-27bf0f001988): created successfully
Apr 13 17:09:37 devstack sudo[88131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959 1073741824
Apr 13 17:09:37 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0abd1e-6dd0-4402-be60-052e09d9af9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (f6f1f88e-3411-4842-8c9a-73ccf3b3bc4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e23df5b5-e678-4459-80bf-6f1945734b03 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created volume successfully.
Apr 13 17:09:38 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959 1073741824" returned: 0 in 0.732s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:38 devstack sudo[88136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959
Apr 13 17:09:38 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:38 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.223s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca245f1-18d0-463d-854d-1509cf33432a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5316f3-e6f7-4609-8416-63ffdb20b959', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cc4941-4598-451a-82c9-faeca136e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee45ea-5310-481e-b988-b7954c43f1ad]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Volume volume-4e5316f3-e6f7-4609-8416-63ffdb20b959 (4e5316f3-e6f7-4609-8416-63ffdb20b959): created successfully
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cc4941-4598-451a-82c9-faeca136e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Flow 'volume_create_manager' (b58027f3-3e1d-4d40-afca-31089be854b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5d9d6419-ba0f-4ebb-b91f-bf462f50605a tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created volume successfully.
Apr 13 17:09:38 devstack sudo[88139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0
Apr 13 17:09:38 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:39 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" returned: 0 in 0.707s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 2G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 2G" returned: 0 in 0.120s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.867s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5a89c24e-e4cd-43fa-a207-ae3793b5a015 tempest-VolumesExtendTest-1202475663 None] Extend volume completed successfully.
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-4e5316f3-e6f7-4609-8416-63ffdb20b959-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-4e5316f3-e6f7-4609-8416-63ffdb20b959-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-quobyte-4e5316f3-e6f7-4609-8416-63ffdb20b959" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-4e5316f3-e6f7-4609-8416-63ffdb20b959" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8554aa-3aaf-43e4-b6c1-49fd612ebaa5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:39 devstack sudo[88164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959
Apr 13 17:09:39 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Flow 'volume_create_manager' (f0c3cec4-4ada-4e33-a186-433bad552c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23b7a71-8ff4-4758-a2c1-390069c6e160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23b7a71-8ff4-4758-a2c1-390069c6e160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1246490286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25a44b4-9933-44ca-ae3c-e81d5e5ea265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e269a04e2b4eee88471f8405fd38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:40Z,use_quota=True,user_id='6dd0bd46feba48fb800a778b13b894a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015d1665-68ae-4009-a538-907c4f49e6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015d1665-68ae-4009-a538-907c4f49e6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98affeef-a7b7-4cd3-a7c7-1868e51387ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98affeef-a7b7-4cd3-a7c7-1868e51387ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25a44b4-9933-44ca-ae3c-e81d5e5ea265', 'volume_name': 'volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993b57f0-064d-4abf-ab4f-4563200024df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993b57f0-064d-4abf-ab4f-4563200024df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db5b39f-5139-41d3-856f-1baa2943ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:40 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Volume e25a44b4-9933-44ca-ae3c-e81d5e5ea265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265', 'volume_size': 1}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1246490286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25a44b4-9933-44ca-ae3c-e81d5e5ea265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e269a04e2b4eee88471f8405fd38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:40Z,use_quota=True,user_id='6dd0bd46feba48fb800a778b13b894a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Creating volume e25a44b4-9933-44ca-ae3c-e81d5e5ea265 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:40 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Acquiring lock "cinder-c83e34f3-7d1d-44b6-a6da-27ef27bde308-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:40 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265 1073741824
Apr 13 17:09:40 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Lock "cinder-c83e34f3-7d1d-44b6-a6da-27ef27bde308-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Acquiring lock "cinder-quobyte-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Acquiring lock "cinder-quobyte-c83e34f3-7d1d-44b6-a6da-27ef27bde308" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-c83e34f3-7d1d-44b6-a6da-27ef27bde308" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Deleting offline snapshot c83e34f3-7d1d-44b6-a6da-27ef27bde308 of volume 6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] snapshot_file for this snap is: volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e18a3-35d1-4bff-a3f7-7e1f60af0b13]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:40 devstack sudo[88168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308
Apr 13 17:09:40 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:40 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959" returned: 0 in 0.614s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:40 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959
Apr 13 17:09:40 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:40 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265 1073741824" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:40 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265
Apr 13 17:09:40 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:40 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308" returned: 0 in 0.545s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cd9a4a-2f99-439e-8ba8-6a1cdb5c0347]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:40 devstack sudo[88183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0
Apr 13 17:09:40 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:40 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4e5316f3-e6f7-4609-8416-63ffdb20b959" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-4e5316f3-e6f7-4609-8416-63ffdb20b959" released by "delete_volume" :: held 1.108s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created reservations ['e1307008-9ccc-4176-b185-6a881fc3458a', 'd175c039-9abd-42bc-959e-31acbcfa67ea', '7d4f55b3-82b4-48d1-b6a8-4a43ee091cb1', '4e3d47f5-3c8e-4498-b668-b4b4ba225d68'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:41 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:41 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:41 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db5b39f-5139-41d3-856f-1baa2943ef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093e71c9-8c8c-4e74-9d85-275144b58edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:41 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Volume volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265 (e25a44b4-9933-44ca-ae3c-e81d5e5ea265): created successfully
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093e71c9-8c8c-4e74-9d85-275144b58edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Flow 'volume_create_manager' (f0c3cec4-4ada-4e33-a186-433bad552c8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bf1c9fc3-52f2-4dd8-b3ef-b76581b5557f tempest-VolumeQuotasAdminTestJSON-204151553 None] Created volume successfully.
Apr 13 17:09:41 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:41 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308
Apr 13 17:09:41 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:41 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Deleted volume successfully.
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e97501a-2ac4-49c4-8962-f89caa45b4f6 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-4e5316f3-e6f7-4609-8416-63ffdb20b959-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:41 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:41 devstack sudo[88198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308
Apr 13 17:09:41 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-quobyte-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[634e990d-ddb6-467f-921e-d086f1be24d3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:42 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0.c83e34f3-7d1d-44b6-a6da-27ef27bde308" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-c83e34f3-7d1d-44b6-a6da-27ef27bde308" released by "_delete_snapshot" :: held 2.105s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" released by "delete_snapshot" :: held 2.114s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Acquiring lock "cinder-e25a44b4-9933-44ca-ae3c-e81d5e5ea265-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "cinder-e25a44b4-9933-44ca-ae3c-e81d5e5ea265-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:42 devstack sudo[88201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988
Apr 13 17:09:42 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Acquiring lock "cinder-quobyte-e25a44b4-9933-44ca-ae3c-e81d5e5ea265" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "cinder-quobyte-e25a44b4-9933-44ca-ae3c-e81d5e5ea265" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Created reservations ['e9083f7f-38d2-4aef-afb3-0dbefcb27782', '14e0c783-a9ca-4cf8-a95c-4fee9e215153', '2a39d5c2-9966-44b6-b767-cbc11656be07', 'bcc8f84f-b53e-4e6c-9ff2-08e5b48eeea2'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c06b94-3ddf-4cca-8d50-ea0627a1d13b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Delete snapshot completed successfully.
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b4af4120-540b-48f3-8881-63d37e28906a tempest-VolumesExtendTest-1202475663 None] Lock "cinder-c83e34f3-7d1d-44b6-a6da-27ef27bde308-delete_snapshot" released by "delete_snapshot" :: held 2.258s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:42 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265
Apr 13 17:09:42 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:42 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988" returned: 0 in 0.558s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:42 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988
Apr 13 17:09:42 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:42 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265" returned: 0 in 0.516s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:42 devstack sudo[88216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265
Apr 13 17:09:42 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:43 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988" released by "delete_volume" :: held 0.982s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created reservations ['765288ce-5d92-4789-a7c5-2d95af327b20', 'b75c96bd-983b-499e-b094-e3cd0bbb8ef1', 'e8a2d7b5-7d99-44fb-8962-d9ac09724b21', 'cad4cf0e-147e-4c7c-91be-4195f380f76b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:43 devstack sudo[88220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:43 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "cinder-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:43 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e25a44b4-9933-44ca-ae3c-e81d5e5ea265" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "cinder-quobyte-e25a44b4-9933-44ca-ae3c-e81d5e5ea265" released by "delete_volume" :: held 1.013s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "cinder-quobyte-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Created reservations ['3498bfd6-14f6-42c9-ae07-b5016a0f56de', 'ca63a7d8-78c3-4950-8399-5b479e172b5f', 'b6bd31a9-6893-4ad2-b998-0816e1d0bbb3', '47cf1a55-aea9-4e91-aaa8-27659ddfb473'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f56bd5-f717-4dab-a37d-47204c3004e6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:43 devstack sudo[88223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:43 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:43 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0
Apr 13 17:09:43 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:43 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:43 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Deleted volume successfully.
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9f616215-6dba-44d2-8055-5ff9ea43d118 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-fb7a1ed3-1f56-45d6-bf1b-27bf0f001988-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:43 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:43 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Deleted volume successfully.
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03226d2d-1486-45b2-8026-9e28a07cbe38 tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "cinder-e25a44b4-9933-44ca-ae3c-e81d5e5ea265-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:43 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:43 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0
Apr 13 17:09:43 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-36d0f758-bdaa-4e97-ab4a-db67b0006071-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-36d0f758-bdaa-4e97-ab4a-db67b0006071-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-quobyte-36d0f758-bdaa-4e97-ab4a-db67b0006071" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-36d0f758-bdaa-4e97-ab4a-db67b0006071" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f815cecb-19a5-4fb5-8596-5f0e6e3f663d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:44 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-quobyte-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0" released by "delete_volume" :: held 1.146s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Created reservations ['14106ff1-2773-4cac-8e26-b520c3cb284c', '862cdf01-e465-4f18-8e1c-6d1aee1e4987', 'f128a684-6076-4696-a35d-b5fddc676efe', '8ca613f6-4082-49bf-a3c1-26147893a55c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:44 devstack sudo[88259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071
Apr 13 17:09:44 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:44 devstack sudo[88262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:44 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Flow 'volume_create_manager' (1345bfd3-1553-42ef-bdfa-ccd1b3f22683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54166e67-aefc-4f3c-8769-d0d0f698da6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54166e67-aefc-4f3c-8769-d0d0f698da6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1149998413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d73ac15-7df1-404b-9986-166f000cbd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e269a04e2b4eee88471f8405fd38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:45Z,use_quota=True,user_id='6dd0bd46feba48fb800a778b13b894a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabfd465-cc8c-4794-a3a6-a5cc27718849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabfd465-cc8c-4794-a3a6-a5cc27718849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2e7411-852d-4828-a88e-a9a355066007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2e7411-852d-4828-a88e-a9a355066007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d73ac15-7df1-404b-9986-166f000cbd6d', 'volume_name': 'volume-5d73ac15-7df1-404b-9986-166f000cbd6d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6044a4b6-56ae-40f3-8ca4-ff6400b9acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6044a4b6-56ae-40f3-8ca4-ff6400b9acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eec4bda-9dd2-478d-ba13-e5fa04793a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Volume 5d73ac15-7df1-404b-9986-166f000cbd6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d73ac15-7df1-404b-9986-166f000cbd6d', 'volume_size': 1}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1149998413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d73ac15-7df1-404b-9986-166f000cbd6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92e269a04e2b4eee88471f8405fd38e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:45Z,use_quota=True,user_id='6dd0bd46feba48fb800a778b13b894a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Creating volume 5d73ac15-7df1-404b-9986-166f000cbd6d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:45 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:45 devstack sudo[88266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d 1073741824
Apr 13 17:09:45 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:45 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071" returned: 0 in 0.820s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:45 devstack sudo[88271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071
Apr 13 17:09:45 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:45 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.802s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Deleted volume successfully.
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-feafe6a5-a104-4d84-88de-ddb8a0866ba2 tempest-VolumesExtendTest-1202475663 None] Lock "cinder-6ba4bf1d-0988-4e0d-9273-56a0a00acbe0-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:45 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d 1073741824" returned: 0 in 0.633s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:45 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-36d0f758-bdaa-4e97-ab4a-db67b0006071" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-36d0f758-bdaa-4e97-ab4a-db67b0006071" released by "delete_volume" :: held 1.417s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created reservations ['480d5451-27bb-4149-8258-291b13b0bd5b', '7489c13e-f99b-4036-9bab-57b30186899c', 'bfc7ce10-5b8e-41eb-ac37-8885a32cb1d9', '7fb72196-78b9-41d7-9ba6-a1950a1fa165'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:45 devstack sudo[88278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d
Apr 13 17:09:45 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:45 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:45 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df9d785b-83c4-44e8-bf65-5496917e03ee tempest-VolumesActionsTest-1919306332 None] Acquiring lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6" by "attach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df9d785b-83c4-44e8-bf65-5496917e03ee tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6" acquired by "attach_volume" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:46 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.651s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-df9d785b-83c4-44e8-bf65-5496917e03ee tempest-VolumesActionsTest-1919306332 None] Attaching volume 83d9cea4-cfbc-4283-90f2-764889042aa6 to instance e8469f8a-372f-48b6-9f1d-8532de9770c0 at mountpoint /dev/vdb on host None.
Apr 13 17:09:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Deleted volume successfully.
Apr 13 17:09:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-df9d785b-83c4-44e8-bf65-5496917e03ee tempest-VolumesActionsTest-1919306332 None] Attach volume completed successfully.
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c0ce04a-5d5b-42aa-8742-d4e560bca205 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-36d0f758-bdaa-4e97-ab4a-db67b0006071-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-df9d785b-83c4-44e8-bf65-5496917e03ee tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6" released by "attach_volume" :: held 0.126s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-5d030130-9a23-4165-90be-726a01336494-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-5d030130-9a23-4165-90be-726a01336494-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-quobyte-5d030130-9a23-4165-90be-726a01336494" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-5d030130-9a23-4165-90be-726a01336494" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4bf4a-fc01-4c61-99d2-0f773b727eab]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:46 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494
Apr 13 17:09:46 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:46 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d" returned: 0 in 1.094s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eec4bda-9dd2-478d-ba13-e5fa04793a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d73ac15-7df1-404b-9986-166f000cbd6d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b55a655-9049-494e-94ea-29e8682aba3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Volume volume-5d73ac15-7df1-404b-9986-166f000cbd6d (5d73ac15-7df1-404b-9986-166f000cbd6d): created successfully
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b55a655-9049-494e-94ea-29e8682aba3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Flow 'volume_create_manager' (1345bfd3-1553-42ef-bdfa-ccd1b3f22683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7ae26cbc-0bae-4754-bd2a-821673ac195e tempest-VolumeQuotasAdminTestJSON-204151553 None] Created volume successfully.
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-89917600-661c-4c8a-b0c6-aea848e49bba tempest-VolumesActionsTest-1919306332 None] Acquiring lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-89917600-661c-4c8a-b0c6-aea848e49bba tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-89917600-661c-4c8a-b0c6-aea848e49bba tempest-VolumesActionsTest-1919306332 None] Detaching volume 83d9cea4-cfbc-4283-90f2-764889042aa6 from instance e8469f8a-372f-48b6-9f1d-8532de9770c0.
Apr 13 17:09:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-89917600-661c-4c8a-b0c6-aea848e49bba tempest-VolumesActionsTest-1919306332 None] Detach volume completed successfully.
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-89917600-661c-4c8a-b0c6-aea848e49bba tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:47 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494" returned: 0 in 0.642s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:47 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494
Apr 13 17:09:47 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-dd77ded3-f28d-4ce2-9547-e4a56aa21d43 tempest-VolumeQuotasAdminTestJSON-1025759058 None] Transfer volume completed successfully.
Apr 13 17:09:47 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d030130-9a23-4165-90be-726a01336494" returned: 0 in 0.400s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-5d030130-9a23-4165-90be-726a01336494" released by "delete_volume" :: held 1.078s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created reservations ['8c1ba031-442c-40b1-93ff-cae6e7046d6f', 'daea58cc-36a3-46de-80d0-b70b530cf837', '99e09f18-35c9-4619-8280-76bd1f490e5a', '01f5e180-6ac7-40dc-9942-dca966871911'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:47 devstack sudo[88292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:47 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Flow 'volume_create_manager' (1722eab4-3707-4988-ba28-903848c5f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488519ec-48dd-4e4e-ac33-a0365e004f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-b18205da-6047-45f2-8a45-7a007b439039-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488519ec-48dd-4e4e-ac33-a0365e004f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-620739445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d15e70-f0aa-43dc-8ff2-96cd55653d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2256e89378864728a40c561159469b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:48Z,use_quota=True,user_id='74f6ae164d5a49ea9cbf63b2939966bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92d498c-cc6b-41dc-8e2a-bceb11c6ef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92d498c-cc6b-41dc-8e2a-bceb11c6ef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cfabb4-e599-4e9f-a296-31b97d9766ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93cfabb4-e599-4e9f-a296-31b97d9766ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d15e70-f0aa-43dc-8ff2-96cd55653d25', 'volume_name': 'volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fe7d9e-186b-4201-b421-f01183914576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fe7d9e-186b-4201-b421-f01183914576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dc501d-ed1a-436f-b692-4cb9b65271ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:48 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25', 'volume_size': 1}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-620739445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d15e70-f0aa-43dc-8ff2-96cd55653d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2256e89378864728a40c561159469b3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:48Z,use_quota=True,user_id='74f6ae164d5a49ea9cbf63b2939966bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Creating volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:48 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:48 devstack sudo[88295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 1073741824
Apr 13 17:09:48 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-b18205da-6047-45f2-8a45-7a007b439039-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-quobyte-b18205da-6047-45f2-8a45-7a007b439039" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-b18205da-6047-45f2-8a45-7a007b439039" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f8ba58-e669-4040-8829-a63cc7b4863a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:48 devstack sudo[88297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039
Apr 13 17:09:48 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Acquiring lock "cinder-5d73ac15-7df1-404b-9986-166f000cbd6d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Lock "cinder-5d73ac15-7df1-404b-9986-166f000cbd6d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Acquiring lock "cinder-quobyte-5d73ac15-7df1-404b-9986-166f000cbd6d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Lock "cinder-quobyte-5d73ac15-7df1-404b-9986-166f000cbd6d" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:48 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.920s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Deleted volume successfully.
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e676e-813f-4ad5-ba0f-79fdae1ef635]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9c99fd00-d5b0-41d8-adf5-3046c6f76832 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-5d030130-9a23-4165-90be-726a01336494-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:48 devstack sudo[88305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d
Apr 13 17:09:48 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:48 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 1073741824" returned: 0 in 0.710s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:49 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25
Apr 13 17:09:49 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:49 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039" returned: 0 in 0.788s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:49 devstack sudo[88313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039
Apr 13 17:09:49 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:49 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d" returned: 0 in 0.696s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:49 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:49 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d
Apr 13 17:09:49 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25" returned: 0 in 0.569s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47dc501d-ed1a-436f-b692-4cb9b65271ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00423fe-11ad-4925-8a01-0ac4ae8252ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:49 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Volume volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 (58d15e70-f0aa-43dc-8ff2-96cd55653d25): created successfully
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00423fe-11ad-4925-8a01-0ac4ae8252ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Flow 'volume_create_manager' (1722eab4-3707-4988-ba28-903848c5f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6ec2a057-6c56-49b8-adf0-2a8771248d85 tempest-VolumesSnapshotListTestJSON-1428959204 None] Created volume successfully.
Apr 13 17:09:49 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b18205da-6047-45f2-8a45-7a007b439039" returned: 0 in 0.559s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-b18205da-6047-45f2-8a45-7a007b439039" released by "delete_volume" :: held 1.428s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created reservations ['407093da-e74e-4668-b5ac-5085220ae8fd', '0fdb8d78-c182-4aa6-bae3-f74a271a38a1', '2b30644d-00c2-47e5-aebd-546de0e99b16', '48610c27-1604-43fb-a6ba-5d55b33e69e3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:49 devstack sudo[88350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:49 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:50 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5d73ac15-7df1-404b-9986-166f000cbd6d" returned: 0 in 0.539s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Lock "cinder-quobyte-5d73ac15-7df1-404b-9986-166f000cbd6d" released by "delete_volume" :: held 1.307s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Created reservations ['c1db7854-8c3c-4ce9-8fb5-c9a9334f0604', '1cb14b8f-747e-4080-a130-7e1e3af27b46', 'd222ac3d-669f-4181-a06d-5a98e0133fdc', 'eb554f7e-e85c-49de-b2ea-0c701c40bb45'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:50 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:50 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-51a45e84-b407-49ca-939d-aa64697224dc-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-51a45e84-b407-49ca-939d-aa64697224dc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "cinder-quobyte-51a45e84-b407-49ca-939d-aa64697224dc" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-51a45e84-b407-49ca-939d-aa64697224dc" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc737a9-d6ad-42b8-a0b3-e807353d947c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Creating offline snapshot 975c0245-3465-4d5d-8849-bf800de916ca of volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[763902b5-0dc4-4fd0-9755-03920ea7c4ba]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:50 devstack sudo[88356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc
Apr 13 17:09:50 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:50 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.562s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Deleted volume successfully.
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ea861a7-6ce7-4228-9b36-6d33b0102f74 tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-b18205da-6047-45f2-8a45-7a007b439039-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:50 devstack sudo[88357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25
Apr 13 17:09:50 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:50 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.572s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Deleted volume successfully.
Apr 13 17:09:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a9e83f2-4a6f-45ba-9114-4e7abbcb9210 tempest-VolumeQuotasAdminTestJSON-322570066 None] Lock "cinder-5d73ac15-7df1-404b-9986-166f000cbd6d-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:51 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc" returned: 0 in 0.719s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:51 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc
Apr 13 17:09:51 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:51 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25" returned: 0 in 0.703s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:51 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca 1G
Apr 13 17:09:51 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:51 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-51a45e84-b407-49ca-939d-aa64697224dc" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-quobyte-51a45e84-b407-49ca-939d-aa64697224dc" released by "delete_volume" :: held 1.208s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Created reservations ['209d3ad3-c321-46db-854f-9429c7ed0bd1', 'b6c882c0-06b4-42ce-8fbb-6124236e3d9c', '8203ed29-b46e-4200-9c13-992f67f488b9', '5a4d5dd8-04b5-441e-ae33-b59cecf8011c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:51 devstack sudo[88380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:51 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:51 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca 1G" returned: 0 in 0.660s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:51 devstack sudo[88385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca
Apr 13 17:09:51 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:52 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.499s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:52 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:09:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Deleted volume successfully.
Apr 13 17:09:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6b72f595-8e29-4965-9530-2cb129a6948b tempest-CreateVolumesFromSourceVolumeTest-1344390300 None] Lock "cinder-51a45e84-b407-49ca-939d-aa64697224dc-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:52 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:52 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca is being set with open permissions: ugo+rw
Apr 13 17:09:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:52 devstack sudo[88391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca
Apr 13 17:09:52 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:52 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:52 devstack sudo[88394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.info
Apr 13 17:09:52 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:53 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.info" returned: 0 in 0.639s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:53 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.info is being set with open permissions: ugo+rw
Apr 13 17:09:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:53 devstack sudo[88397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.info
Apr 13 17:09:53 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:54 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.info" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.630s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-89b0bb64-3a91-4251-bb4f-543978715883 tempest-VolumesSnapshotListTestJSON-1428959204 None] Create snapshot completed successfully
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (ef4059be-3927-4ba8-9979-16281ba1a0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20eb7c2-43e4-4159-979b-3f5b1be84b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20eb7c2-43e4-4159-979b-3f5b1be84b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-158274484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e40146a-5c0d-4552-bbc3-36c6379a31a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824069f6ac264bf5b9dde9d2bd48b4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:54Z,use_quota=True,user_id='c626352cf34f45b5a69e160fbc61588a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b0b945-f169-41a0-b8fa-d97a4c015571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61b0b945-f169-41a0-b8fa-d97a4c015571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b35ae9-e20a-4787-a9cc-98f8cd158eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b35ae9-e20a-4787-a9cc-98f8cd158eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e40146a-5c0d-4552-bbc3-36c6379a31a9', 'volume_name': 'volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c0363d-11cf-48c8-a99c-17d85b9872c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87c0363d-11cf-48c8-a99c-17d85b9872c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eeeca45-2dc2-4b98-a281-91ee30ee6ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Volume 1e40146a-5c0d-4552-bbc3-36c6379a31a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9', 'volume_size': 1}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-158274484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e40146a-5c0d-4552-bbc3-36c6379a31a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824069f6ac264bf5b9dde9d2bd48b4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:54Z,use_quota=True,user_id='c626352cf34f45b5a69e160fbc61588a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Creating volume 1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:54 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:54 devstack sudo[88400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 1073741824
Apr 13 17:09:54 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:55 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 1073741824" returned: 0 in 0.606s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:55 devstack sudo[88405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9
Apr 13 17:09:55 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Flow 'volume_create_manager' (620b5359-57be-4ff8-ab65-2e95594dd68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8dcb04-97ac-457a-ad64-d5312400e329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8dcb04-97ac-457a-ad64-d5312400e329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1145907487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de95eb9aeede498483b0e7853c4a1474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:55Z,use_quota=True,user_id='47ed64202bf24f829249dcdb976aba19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba33e80-27f6-424a-bfe6-4b1976f04993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dba33e80-27f6-424a-bfe6-4b1976f04993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5a675-673b-4721-b718-4904e8f3ceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5a675-673b-4721-b718-4904e8f3ceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5', 'volume_name': 'volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02570c1b-0ca9-44e4-b492-af4c4537f87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02570c1b-0ca9-44e4-b492-af4c4537f87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a21793a-b046-41c5-9369-2aef1cdabf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Volume 8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5', 'volume_size': 1}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:55 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.896s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eeeca45-2dc2-4b98-a281-91ee30ee6ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aed7c31-868a-4181-a75d-a890d5a176e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Volume volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 (1e40146a-5c0d-4552-bbc3-36c6379a31a9): created successfully
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aed7c31-868a-4181-a75d-a890d5a176e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (ef4059be-3927-4ba8-9979-16281ba1a0aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Creating offline snapshot 057987b3-808a-49cb-9ce4-766216c31e12 of volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:09:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2a42ba57-9363-4e77-b1f3-49107793c4b3 tempest-VolumeDependencyTests-1993529670 None] Created volume successfully.
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7511ff95-6e99-47d5-95f5-13b5712afcc9]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:55 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca
Apr 13 17:09:55 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:56 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:09:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:56 devstack sudo[88447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 1G
Apr 13 17:09:56 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:56 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 1G" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:56 devstack sudo[88452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12
Apr 13 17:09:56 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:57 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12" returned: 0 in 0.430s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:57 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 is being set with open permissions: ugo+rw
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:57 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12
Apr 13 17:09:57 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:57 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12" returned: 0 in 0.388s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=227,cinder:UPDATE=255,cinder:INSERT=70,cinder:DELETE=22 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1145907487',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de95eb9aeede498483b0e7853c4a1474',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:09:55Z,use_quota=True,user_id='47ed64202bf24f829249dcdb976aba19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Creating volume 8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:09:57 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:57 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 1073741824
Apr 13 17:09:57 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-df193b1d-2b6f-4834-99f1-c9e3298c36b0 tempest-VolumesSnapshotListTestJSON-1428959204 None] Create snapshot completed successfully
Apr 13 17:09:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:58 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 1073741824" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:58 devstack sudo[88465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5
Apr 13 17:09:58 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:58 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.679s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a21793a-b046-41c5-9369-2aef1cdabf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29a6f0a-ace7-4fc1-8948-7b52886b6891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de04ba-7a6d-4c57-bec5-0789d7e46296]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=212,cinder:UPDATE=299,cinder:DELETE=22,cinder:INSERT=67 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:09:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Volume volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 (8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5): created successfully
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29a6f0a-ace7-4fc1-8948-7b52886b6891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Flow 'volume_create_manager' (620b5359-57be-4ff8-ab65-2e95594dd68e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:09:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f5808c0d-5736-4626-be48-26b06b7ebbb2 tempest-VolumesServicesTestJSON-1539364869 None] Created volume successfully.
Apr 13 17:09:58 devstack sudo[88468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:09:58 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Acquiring lock "cinder-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Lock "cinder-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Acquiring lock "cinder-quobyte-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Lock "cinder-quobyte-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1742103-bd2a-48cd-ab40-8a242ab1a1fe]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:58 devstack sudo[88470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5
Apr 13 17:09:58 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:59 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[955417ed-d247-4e92-9863-4f514f54cace]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:59 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:09:59 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:59 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:59 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5
Apr 13 17:09:59 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:59 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e1fc066-6fd8-4aea-ba6f-c581172026ccfsgbamq9.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:59 devstack sudo[88486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e1fc066-6fd8-4aea-ba6f-c581172026ccfsgbamq9.img
Apr 13 17:09:59 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:09:59 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Lock "cinder-quobyte-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5" released by "delete_volume" :: held 0.937s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Created reservations ['ff1ed0f6-9fd0-4d7b-9c35-235205c045d7', '1d0f8ec7-d1bc-4153-abb8-2339ba4a0ba3', '9992601c-721c-40cb-bd10-084c13f4c29d', '4d38459f-3654-41c2-b047-8b4a879b6a35'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:09:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:09:59 devstack sudo[88489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:09:59 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:01 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.592s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:01 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Deleted volume successfully.
Apr 13 17:10:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-587a54c2-8f1a-4556-b5e9-53df008e49bb tempest-VolumesServicesTestJSON-1539364869 None] Lock "cinder-8fdb1f7a-33a6-4ec0-9014-7ec8b939e8b5-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:01 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e1fc066-6fd8-4aea-ba6f-c581172026ccfsgbamq9.img" returned: 0 in 2.234s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b552563f-f97e-4932-b620-8168c89d0f07]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:01 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:10:01 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:02 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.672s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:02 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e1fc066-6fd8-4aea-ba6f-c581172026ccfsgbamq9.img {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:10:02 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Converted 1024.00 MB image at 458.11 MB/s
Apr 13 17:10:02 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] 8e1fc066-6fd8-4aea-ba6f-c581172026cc was raw, no need to convert to raw {{(pid=82641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 13 17:10:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:10:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:12 devstack sudo[88515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:10:12 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:12 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.502s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Uploaded volume to glance image-id: 8e1fc066-6fd8-4aea-ba6f-c581172026cc. {{(pid=82641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.282s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Creating offline snapshot 88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 of volume 1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:10:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ffdb0e57-c595-474f-934b-7ce8f309a9a3 tempest-VolumesActionsTest-1919306332 None] Copy volume to image completed successfully.
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb7e091-604b-4e6a-a643-7560a0d659c8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:13 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9
Apr 13 17:10:13 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:10:13 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9" returned: 0 in 0.636s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:13 devstack sudo[88523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 1G
Apr 13 17:10:13 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:14 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 1G" returned: 0 in 0.576s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:14 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3
Apr 13 17:10:14 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:14 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:14 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 is being set with open permissions: ugo+rw
Apr 13 17:10:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:14 devstack sudo[88533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3
Apr 13 17:10:14 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:15 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" returned: 0 in 0.491s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:15 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.info
Apr 13 17:10:15 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:15 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.info" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:15 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.info is being set with open permissions: ugo+rw
Apr 13 17:10:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:15 devstack sudo[88539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.info
Apr 13 17:10:15 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:16 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.info" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.263s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.330s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Creating offline snapshot 80f55560-fd5b-4a42-8c72-6f4ceeb96b2c of volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:10:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-46e72d1f-41da-44c1-8f56-2b97e416a14e tempest-VolumeDependencyTests-1993529670 None] Create snapshot completed successfully
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecdeb00-f419-4342-a4e8-1c01d7d32d37]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:16 devstack sudo[88542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12
Apr 13 17:10:16 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (5f1aebb5-da90-417d-beec-2b310a8e98d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f00bd4-2f90-4fd0-b249-2a7a6ec734f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f00bd4-2f90-4fd0-b249-2a7a6ec734f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-372704782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8cd50a-67c1-4126-941e-9b0e57627ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824069f6ac264bf5b9dde9d2bd48b4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=88bcc04e-0893-4c72-8cb9-f1dc43aa69a3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:17Z,use_quota=True,user_id='c626352cf34f45b5a69e160fbc61588a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccfc4ff-52cf-4fb7-a282-5a6b53989fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccfc4ff-52cf-4fb7-a282-5a6b53989fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19f3d19-7037-4581-b865-88a682689151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19f3d19-7037-4581-b865-88a682689151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f8cd50a-67c1-4126-941e-9b0e57627ef4', 'volume_name': 'volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4', 'volume_size': 1, 'snapshot_id': '88bcc04e-0893-4c72-8cb9-f1dc43aa69a3'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8ec914-a6c8-4563-835b-9690663bb310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8ec914-a6c8-4563-835b-9690663bb310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1ab23d-00f8-44a4-b81b-3e7227963836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Volume 3f8cd50a-67c1-4126-941e-9b0e57627ef4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4', 'volume_size': 1, 'snapshot_id': '88bcc04e-0893-4c72-8cb9-f1dc43aa69a3'}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:16 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12" returned: 0 in 0.649s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:17 devstack sudo[88548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c 1G
Apr 13 17:10:17 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:17 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c 1G" returned: 0 in 0.694s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:17 devstack sudo[88553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c
Apr 13 17:10:17 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:18 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:18 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c is being set with open permissions: ugo+rw
Apr 13 17:10:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:18 devstack sudo[88558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c
Apr 13 17:10:18 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:18 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.740s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e5d1b4-78d3-4c3f-998b-b6e8a35d43a5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3739dd1b-b63c-4fe3-8276-2f3d7155bb68 tempest-VolumesSnapshotListTestJSON-1428959204 None] Create snapshot completed successfully
Apr 13 17:10:18 devstack sudo[88561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:10:18 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:19 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbde5259-ebf6-47f7-a1e2-978ccda5cc0f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:19 devstack sudo[88567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:10:19 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:19 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.719s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:19 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img
Apr 13 17:10:19 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-80f55560-fd5b-4a42-8c72-6f4ceeb96b2c-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-80f55560-fd5b-4a42-8c72-6f4ceeb96b2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-quobyte-80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Deleting offline snapshot 80f55560-fd5b-4a42-8c72-6f4ceeb96b2c of volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] snapshot_file for this snap is: volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40952f3-0d72-4f70-b02d-bc4deade65fb]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:21 devstack sudo[88585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c
Apr 13 17:10:21 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:22 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img" returned: 0 in 2.259s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f444c-9e57-4f5b-ba8e-42f9cbaa758d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:22 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" returned: 0 in 1.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[61383a02-66e7-47d8-bc8d-a0384a3c27e9]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:22 devstack sudo[88591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:10:22 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:22 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12
Apr 13 17:10:22 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:22 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:22 devstack sudo[88600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c
Apr 13 17:10:22 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:22 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.753s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:10:22 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Converted 1024.00 MB image at 452.88 MB/s
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] 8e100369-57ff-4309-8519-da18193c14d0 was raw, converting to qcow2 {{(pid=82641) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f49e392-7154-4a8d-aa08-51a3bcf7bfd4]: (4, 'raw') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:23 devstack sudo[88603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img
Apr 13 17:10:23 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:23 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" returned: 0 in 0.622s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:23 devstack sudo[88608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c
Apr 13 17:10:23 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:23 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img" returned: 0 in 0.597s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:23 devstack sudo[88612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img
Apr 13 17:10:23 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:23 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-80f55560-fd5b-4a42-8c72-6f4ceeb96b2c" released by "_delete_snapshot" :: held 3.117s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" released by "delete_snapshot" :: held 3.145s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Created reservations ['37790970-5b2e-49ba-b7fe-d4d6ee5cc04a', '728d7148-3ccf-4d00-9233-3bd381af351a', 'd9f194c5-179e-48ef-a0fd-2d7ca1a49ebe', 'acdc0173-d8cd-4797-a2ff-8b94133984f1'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Delete snapshot completed successfully.
Apr 13 17:10:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a0a6858a-b4e2-41a0-b889-508374543aab tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-80f55560-fd5b-4a42-8c72-6f4ceeb96b2c-delete_snapshot" released by "delete_snapshot" :: held 3.269s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:24 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img" returned: 1 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img' failed. Not Retrying. {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img /opt/stack/data/cinder/conversion/vol_upload_ls1rvdv7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:24 devstack sudo[88621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img /opt/stack/data/cinder/conversion/vol_upload_ls1rvdv7
Apr 13 17:10:24 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:24 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img /opt/stack/data/cinder/conversion/vol_upload_ls1rvdv7" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Image conversion details: src /opt/stack/data/cinder/conversion/83d9cea4-cfbc-4283-90f2-764889042aa6.temp_image.8e100369-57ff-4309-8519-da18193c14d0nq2u697o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ls1rvdv7 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:10:24 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb0a679-f665-4843-af7e-1b587b3f6de9]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ls1rvdv7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:24 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ls1rvdv7
Apr 13 17:10:24 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-057987b3-808a-49cb-9ce4-766216c31e12-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-057987b3-808a-49cb-9ce4-766216c31e12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-quobyte-057987b3-808a-49cb-9ce4-766216c31e12" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-057987b3-808a-49cb-9ce4-766216c31e12" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Deleting offline snapshot 057987b3-808a-49cb-9ce4-766216c31e12 of volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] snapshot_file for this snap is: volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b671d3-0869-4799-9918-f7bcd6b42127]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:25 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ls1rvdv7" returned: 0 in 0.504s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:25 devstack sudo[88634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12
Apr 13 17:10:25 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:25 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c61edd2-e535-493b-9b31-f3aa096050cb]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:25 devstack sudo[88639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca
Apr 13 17:10:25 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.239s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Uploaded volume to glance image-id: 8e100369-57ff-4309-8519-da18193c14d0. {{(pid=82641) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3-3f8cd50a-67c1-4126-941e-9b0e57627ef4" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-546fc6ea-5269-4557-a701-df3099de0306 tempest-VolumesActionsTest-1919306332 None] Copy volume to image completed successfully.
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3-3f8cd50a-67c1-4126-941e-9b0e57627ef4" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Creating volume 3f8cd50a-67c1-4126-941e-9b0e57627ef4 from snapshot 88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-3f8cd50a-67c1-4126-941e-9b0e57627ef4" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-3f8cd50a-67c1-4126-941e-9b0e57627ef4" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] snapshot: 88bcc04e-0893-4c72-8cb9-f1dc43aa69a3, volume: 3f8cd50a-67c1-4126-941e-9b0e57627ef4,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb93e8-46a4-4c88-8a90-da46316b2c20]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:26 devstack sudo[88641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3
Apr 13 17:10:26 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:26 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca" returned: 0 in 0.527s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:26 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12
Apr 13 17:10:26 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:26 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" returned: 0 in 0.558s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[04858e90-d8fc-4f27-9927-01cf9b8e7c8a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:26 devstack sudo[88654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9
Apr 13 17:10:26 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:26 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:26 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12
Apr 13 17:10:26 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Acquiring lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Acquiring lock "cinder-quobyte-83d9cea4-cfbc-4283-90f2-764889042aa6" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Lock "cinder-quobyte-83d9cea4-cfbc-4283-90f2-764889042aa6" acquired by "delete_volume" :: waited 0.021s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb8e212-1b86-4bd5-8926-86ee1897ef6d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:26 devstack sudo[88658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:10:26 devstack sudo[88658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:27 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:27 devstack sudo[88664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4
Apr 13 17:10:27 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:27 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.057987b3-808a-49cb-9ce4-766216c31e12" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-057987b3-808a-49cb-9ce4-766216c31e12" released by "_delete_snapshot" :: held 2.166s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" released by "delete_snapshot" :: held 2.180s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Created reservations ['fd2d86c9-94f0-49c8-8b85-f0e9dd4fa5e5', 'e156813a-2059-40e1-ba76-d0c56ca9eba8', 'defb7d84-20b3-4966-8a49-63605fc5721c', '9142408c-4c59-4a10-b817-c715e4347e52'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Delete snapshot completed successfully.
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c22fe63-3b14-4967-af42-a661a124775f tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-057987b3-808a-49cb-9ce4-766216c31e12-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:27 devstack sudo[88658]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:27 devstack sudo[88669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6
Apr 13 17:10:27 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-975c0245-3465-4d5d-8849-bf800de916ca-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:28 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-83d9cea4-cfbc-4283-90f2-764889042aa6" returned: 0 in 0.952s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Lock "cinder-quobyte-83d9cea4-cfbc-4283-90f2-764889042aa6" released by "delete_volume" :: held 1.510s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-975c0245-3465-4d5d-8849-bf800de916ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-quobyte-975c0245-3465-4d5d-8849-bf800de916ca" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-975c0245-3465-4d5d-8849-bf800de916ca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Deleting offline snapshot 975c0245-3465-4d5d-8849-bf800de916ca of volume 58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] snapshot_file for this snap is: volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eb5840-7fb4-4c82-b1a2-1d4d6c09368d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Created reservations ['8e38b990-c5ae-4c32-8a77-bb3427de8b5c', '78058325-a7b8-437a-a79b-42e134d4a9da', 'afcfbc98-1b46-400a-a2e4-b7dd4c7206cc', 'c067d9f2-14dd-40b9-bf4c-4c26eaeb855c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:28 devstack sudo[88684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:10:28 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:28 devstack sudo[88683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca
Apr 13 17:10:28 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:29 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4" returned: 0 in 2.396s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ede5027-7274-4808-a24e-8ab540bf6372]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:29 devstack sudo[88689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9
Apr 13 17:10:29 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:29 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.025s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Deleted volume successfully.
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-07fa88ca-e428-47a8-80e6-c329a6b2139e tempest-VolumesActionsTest-1919306332 None] Lock "cinder-83d9cea4-cfbc-4283-90f2-764889042aa6-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:29 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca" returned: 0 in 1.287s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eee3083-690e-4ba1-86c6-21a3b8112592]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:29 devstack sudo[88694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25
Apr 13 17:10:29 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:30 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9" returned: 0 in 0.778s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:10:30 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Converted 1024.00 MB image at 427.02 MB/s
Apr 13 17:10:30 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 is being set with open permissions: ugo+rw
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:30 devstack sudo[88702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4
Apr 13 17:10:30 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:30 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25" returned: 0 in 0.636s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:30 devstack sudo[88704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca
Apr 13 17:10:30 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:30 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4" returned: 0 in 0.638s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-3f8cd50a-67c1-4126-941e-9b0e57627ef4" released by "_copy_volume_from_snapshot" :: held 4.968s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3-3f8cd50a-67c1-4126-941e-9b0e57627ef4" released by "_create_volume_from_snapshot" :: held 4.984s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.993s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f1ab23d-00f8-44a4-b81b-3e7227963836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4', 'volume_size': 1, 'snapshot_id': '88bcc04e-0893-4c72-8cb9-f1dc43aa69a3'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:30 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000ae24d-461a-405b-8925-3057b3087d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:30 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Volume volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 (3f8cd50a-67c1-4126-941e-9b0e57627ef4): created successfully
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000ae24d-461a-405b-8925-3057b3087d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (5f1aebb5-da90-417d-beec-2b310a8e98d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a2c77c3e-4734-4cb8-9324-f797721d285c tempest-VolumeDependencyTests-1993529670 None] Created volume successfully.
Apr 13 17:10:31 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca" returned: 0 in 0.788s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:31 devstack sudo[88727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca
Apr 13 17:10:31 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:31 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25.975c0245-3465-4d5d-8849-bf800de916ca" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-975c0245-3465-4d5d-8849-bf800de916ca" released by "_delete_snapshot" :: held 3.286s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" released by "delete_snapshot" :: held 3.314s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Created reservations ['b7ee9890-6932-4eb7-be47-26f94e18abc3', '94eb3929-9a89-48e9-a4da-d391b223dd90', 'ec3e343b-6075-4861-99d4-71e3781c34bc', '68a6f10f-1cbf-48da-9ac1-f5021d473baf'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Delete snapshot completed successfully.
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7f1ddf5b-3504-4588-9811-8dc90f42f80e tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-975c0245-3465-4d5d-8849-bf800de916ca-delete_snapshot" released by "delete_snapshot" :: held 3.445s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-1e40146a-5c0d-4552-bbc3-36c6379a31a9" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-1e40146a-5c0d-4552-bbc3-36c6379a31a9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Deleting offline snapshot 88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 of volume 1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] snapshot_file for this snap is: volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ac867-40b9-467e-9e7d-bec7947c36f2]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:31 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3
Apr 13 17:10:31 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:32 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" returned: 0 in 0.580s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf720949-3e8d-446a-be14-21f8a38c1320]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-58d15e70-f0aa-43dc-8ff2-96cd55653d25-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-58d15e70-f0aa-43dc-8ff2-96cd55653d25-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:32 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9
Apr 13 17:10:32 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d1ddb0-37a9-496f-b9ba-1403e9022109]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:32 devstack sudo[88738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25
Apr 13 17:10:32 devstack sudo[88738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:33 devstack sudo[88738]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25" returned: 0 in 0.554s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:33 devstack sudo[88746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25
Apr 13 17:10:33 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:33 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9" returned: 0 in 0.724s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:33 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3
Apr 13 17:10:33 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:33 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-58d15e70-f0aa-43dc-8ff2-96cd55653d25" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-quobyte-58d15e70-f0aa-43dc-8ff2-96cd55653d25" released by "delete_volume" :: held 1.057s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Created reservations ['d15508d2-204a-4b65-9289-f2bcd6eaca0c', 'c7b1eb7c-a81a-447b-af3b-e517c415f336', '508b75ca-93b3-421e-ba0a-0a4c2de145df', '7ab2a6cc-61d1-45ae-94e1-5e0ce5c6110e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:33 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:10:33 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:33 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:33 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3
Apr 13 17:10:33 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Flow 'volume_create_manager' (34fa1783-8b05-443c-8ec9-6509a976e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3f5a53-2959-4223-85a7-67f879ada70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d3f5a53-2959-4223-85a7-67f879ada70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-105138923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81ac698784942879ae44175eadcae1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:34Z,use_quota=True,user_id='051656877a6a44daa931b809b9dc485b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8014e4df-121f-49cd-a514-6aad82916292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8014e4df-121f-49cd-a514-6aad82916292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82cfe2d-910b-4d79-b782-3f31dff01e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82cfe2d-910b-4d79-b782-3f31dff01e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9', 'volume_name': 'volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a3f6a-5f19-4d34-a5d9-fc8c9be2a936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6a3f6a-5f19-4d34-a5d9-fc8c9be2a936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089f7c58-844f-4c42-9cb1-8dd956d4877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Volume 7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9', 'volume_size': 1}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-105138923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81ac698784942879ae44175eadcae1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:34Z,use_quota=True,user_id='051656877a6a44daa931b809b9dc485b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Creating volume 7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:10:34 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:34 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 1073741824
Apr 13 17:10:34 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:34 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.414s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Deleted volume successfully.
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-74d9615c-e4f1-4ff0-8574-7cda1e351ba7 tempest-VolumesSnapshotListTestJSON-1428959204 None] Lock "cinder-58d15e70-f0aa-43dc-8ff2-96cd55653d25-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:34 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9.88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" returned: 0 in 0.491s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3" released by "_delete_snapshot" :: held 2.403s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-1e40146a-5c0d-4552-bbc3-36c6379a31a9" released by "delete_snapshot" :: held 2.417s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Created reservations ['96a92dc9-791e-4a85-913d-2f165f44049d', '1ac49880-9da7-49c0-ac14-69622d319af2', '611adbdc-183d-49e4-bce3-19783b720448', '097a1672-2a6a-4474-bc23-ca07ee867d64'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Delete snapshot completed successfully.
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d4a0ab46-a88d-4a8c-9999-e10aea0875c5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-88bcc04e-0893-4c72-8cb9-f1dc43aa69a3-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:34 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 1073741824" returned: 0 in 0.537s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:34 devstack sudo[88768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9
Apr 13 17:10:34 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:34 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-1e40146a-5c0d-4552-bbc3-36c6379a31a9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-1e40146a-5c0d-4552-bbc3-36c6379a31a9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-1e40146a-5c0d-4552-bbc3-36c6379a31a9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-1e40146a-5c0d-4552-bbc3-36c6379a31a9" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b634f-9340-4dcd-a76b-35886ff29b11]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:35 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9
Apr 13 17:10:35 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:35 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089f7c58-844f-4c42-9cb1-8dd956d4877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f67b37-d0eb-4ac3-abee-3421e0e64d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:35 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Volume volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 (7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9): created successfully
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f67b37-d0eb-4ac3-abee-3421e0e64d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Flow 'volume_create_manager' (34fa1783-8b05-443c-8ec9-6509a976e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7f42d879-9915-4b65-8abb-4b2c7888e24d tempest-VolumesCloneTest-1808169514 None] Created volume successfully.
Apr 13 17:10:35 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:35 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9
Apr 13 17:10:35 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:36 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1e40146a-5c0d-4552-bbc3-36c6379a31a9" returned: 0 in 0.558s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-1e40146a-5c0d-4552-bbc3-36c6379a31a9" released by "delete_volume" :: held 1.165s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Created reservations ['67a426eb-7833-4a7a-9ee9-34e5e3927915', '15144fc8-65bc-4e21-a0ac-1d079d2f174c', 'b6ab9b64-9d61-49d5-b86d-730dbb6021db', '59f8a4eb-2232-4480-b73f-6722428f4ada'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:36 devstack sudo[88805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:10:36 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Flow 'volume_create_manager' (29c9e2c7-07ef-491b-944d-661c69e134cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd14296-25f0-4d7c-a773-90075968579d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd14296-25f0-4d7c-a773-90075968579d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-857207021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c85f0d-e122-48bc-b7e5-9d3880abea4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81ac698784942879ae44175eadcae1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:37Z,use_quota=True,user_id='051656877a6a44daa931b809b9dc485b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2159838d-4957-4344-8f60-0798e8a9ef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2159838d-4957-4344-8f60-0798e8a9ef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e41d1a-a4fb-4706-b3db-4cee28458eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e41d1a-a4fb-4706-b3db-4cee28458eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f4c85f0d-e122-48bc-b7e5-9d3880abea4b', 'volume_name': 'volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b', 'volume_size': 2, 'source_volid': '7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b17df1-dad8-4e66-8438-c2c52c1d138f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b17df1-dad8-4e66-8438-c2c52c1d138f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6243133-20c1-4ffc-b872-ef259302d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Volume f4c85f0d-e122-48bc-b7e5-9d3880abea4b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b', 'volume_size': 2, 'source_volid': '7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9', 'source_volstatus': 'available'}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:36 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Cloning volume 7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 to volume f4c85f0d-e122-48bc-b7e5-9d3880abea4b
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Creating offline snapshot 30bdc448-5c32-4e6c-b873-36c8246dec54 of volume 7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[340aa627-7c9b-472c-9783-676ebd0fcb94]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:36 devstack sudo[88809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9
Apr 13 17:10:36 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:37 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.673s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Deleted volume successfully.
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1c17080d-46ec-40ef-8b54-b91319b7786b tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-1e40146a-5c0d-4552-bbc3-36c6379a31a9-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:37 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" returned: 0 in 0.560s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:37 devstack sudo[88815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 1G
Apr 13 17:10:37 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (2721c824-5f30-4f44-9720-91641a34724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e656c3-c674-4c67-be2e-3902421d9854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4e656c3-c674-4c67-be2e-3902421d9854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2091352044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e24a06-f072-48b4-93e1-60a8b4fee10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824069f6ac264bf5b9dde9d2bd48b4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:37Z,use_quota=True,user_id='c626352cf34f45b5a69e160fbc61588a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86291dcb-9121-49da-bb43-950142294efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86291dcb-9121-49da-bb43-950142294efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaf8225-5145-4abd-98fa-6653bba717a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcaf8225-5145-4abd-98fa-6653bba717a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e24a06-f072-48b4-93e1-60a8b4fee10a', 'volume_name': 'volume-71e24a06-f072-48b4-93e1-60a8b4fee10a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8304ba64-825f-4fc8-9044-aece4f71002d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8304ba64-825f-4fc8-9044-aece4f71002d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d04be87-510a-4dd6-afa7-e727f25b3a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Volume 71e24a06-f072-48b4-93e1-60a8b4fee10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e24a06-f072-48b4-93e1-60a8b4fee10a', 'volume_size': 1}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:37 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 1G" returned: 0 in 0.560s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:37 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54
Apr 13 17:10:37 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:10:38 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (c4b49efd-ecde-4f6f-821b-850f3fd86ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be277ab-cd16-49f6-b0d7-389d435607b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be277ab-cd16-49f6-b0d7-389d435607b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115939860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d00a98c-cf93-41ee-8dee-424cb7867f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:38Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5693b2f4-90a3-41f8-ae38-c405e071e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5693b2f4-90a3-41f8-ae38-c405e071e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a644198f-cde2-48d1-921e-dd19f3cf3a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a644198f-cde2-48d1-921e-dd19f3cf3a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d00a98c-cf93-41ee-8dee-424cb7867f4c', 'volume_name': 'volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdbe014-d309-4148-8f97-acf7255b4924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdbe014-d309-4148-8f97-acf7255b4924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cba33d7-6f27-43f4-90f5-4b578a548201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Volume 2d00a98c-cf93-41ee-8dee-424cb7867f4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c', 'volume_size': 1}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54" returned: 0 in 0.637s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:38 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 is being set with open permissions: ugo+rw
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:38 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54
Apr 13 17:10:38 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:38 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54" returned: 0 in 0.430s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:38 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.info
Apr 13 17:10:38 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:39 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.info" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:39 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.info is being set with open permissions: ugo+rw
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:39 devstack sudo[88832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.info
Apr 13 17:10:39 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:39 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.info" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Acquiring lock "cinder-quobyte-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] snapshot: 30bdc448-5c32-4e6c-b873-36c8246dec54, volume: f4c85f0d-e122-48bc-b7e5-9d3880abea4b,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd5bd0a-c0f0-4df9-8db6-0fc5a67e4582]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:39 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54
Apr 13 17:10:39 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:40 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54d1a37-ba67-439e-83c2-aaff9e90d501]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:40 devstack sudo[88840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9
Apr 13 17:10:40 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:40 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:10:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:40 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b
Apr 13 17:10:40 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:43 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" returned: 0 in 2.226s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd20cff6-1502-4430-b7aa-252370c983a6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:43 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9
Apr 13 17:10:43 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:43 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" returned: 0 in 0.602s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:43 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:10:43 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Converted 1024.00 MB image at 459.84 MB/s
Apr 13 17:10:43 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b is being set with open permissions: ugo+rw
Apr 13 17:10:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:43 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b
Apr 13 17:10:43 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:44 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" released by "_copy_volume_from_snapshot" :: held 4.263s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Acquiring lock "cinder-quobyte-30bdc448-5c32-4e6c-b873-36c8246dec54" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-30bdc448-5c32-4e6c-b873-36c8246dec54" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Deleting offline snapshot 30bdc448-5c32-4e6c-b873-36c8246dec54 of volume 7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] snapshot_file for this snap is: volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f859eb38-9f40-4873-920c-24205961acb2]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:44 devstack sudo[88866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54
Apr 13 17:10:44 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:44 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b957cff-a33e-48be-8d6c-21a1966c02ae]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:44 devstack sudo[88871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9
Apr 13 17:10:44 devstack sudo[88871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:45 devstack sudo[88871]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:45 devstack sudo[88876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54
Apr 13 17:10:45 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:45 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54" returned: 0 in 0.425s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:45 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54
Apr 13 17:10:45 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:45 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9.30bdc448-5c32-4e6c-b873-36c8246dec54" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-30bdc448-5c32-4e6c-b873-36c8246dec54" released by "_delete_snapshot" :: held 1.828s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.271s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.388s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2091352044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e24a06-f072-48b4-93e1-60a8b4fee10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824069f6ac264bf5b9dde9d2bd48b4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:37Z,use_quota=True,user_id='c626352cf34f45b5a69e160fbc61588a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Creating volume 71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:10:45 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6243133-20c1-4ffc-b872-ef259302d454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b', 'volume_size': 2, 'source_volid': '7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4763d-f874-476b-86ba-98bbee0ed78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Volume volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b (f4c85f0d-e122-48bc-b7e5-9d3880abea4b): created successfully
Apr 13 17:10:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4763d-f874-476b-86ba-98bbee0ed78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:45 devstack sudo[88884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a 1073741824
Apr 13 17:10:45 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Flow 'volume_create_manager' (29c9e2c7-07ef-491b-944d-661c69e134cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-94ceeee3-6987-481e-9b78-f87dfc72173d tempest-VolumesCloneTest-1808169514 None] Created volume successfully.
Apr 13 17:10:46 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a 1073741824" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:46 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a
Apr 13 17:10:46 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:46 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a" returned: 0 in 0.397s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.408s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2115939860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d00a98c-cf93-41ee-8dee-424cb7867f4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:38Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Creating volume 2d00a98c-cf93-41ee-8dee-424cb7867f4c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:10:46 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d04be87-510a-4dd6-afa7-e727f25b3a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e24a06-f072-48b4-93e1-60a8b4fee10a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:46 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c 1073741824
Apr 13 17:10:46 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da357d6-1649-458f-b534-8f3b116033fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Volume volume-71e24a06-f072-48b4-93e1-60a8b4fee10a (71e24a06-f072-48b4-93e1-60a8b4fee10a): created successfully
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da357d6-1649-458f-b534-8f3b116033fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (2721c824-5f30-4f44-9720-91641a34724f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6812767c-8861-4719-a1bc-f80cff652558 tempest-VolumeDependencyTests-1993529670 None] Created volume successfully.
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Acquiring lock "cinder-f4c85f0d-e122-48bc-b7e5-9d3880abea4b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Lock "cinder-f4c85f0d-e122-48bc-b7e5-9d3880abea4b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Acquiring lock "cinder-quobyte-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc5b8e2-14e7-44f6-b0a0-4adb827ac452]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:10:47 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b
Apr 13 17:10:47 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (fb04d689-85ba-4f36-82d3-37ff046f8354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd3c2e-cc7d-49e3-9520-7f7661e2b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6dd3c2e-cc7d-49e3-9520-7f7661e2b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-406476840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82edc5de-9cc3-45aa-9e71-b33265a6a167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='824069f6ac264bf5b9dde9d2bd48b4df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=71e24a06-f072-48b4-93e1-60a8b4fee10a,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:47Z,use_quota=True,user_id='c626352cf34f45b5a69e160fbc61588a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec7cea6-3748-4d54-803a-16d9153ef7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ec7cea6-3748-4d54-803a-16d9153ef7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211519c0-3b06-466d-bdaa-aac21b04b005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211519c0-3b06-466d-bdaa-aac21b04b005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '82edc5de-9cc3-45aa-9e71-b33265a6a167', 'volume_name': 'volume-82edc5de-9cc3-45aa-9e71-b33265a6a167', 'volume_size': 1, 'source_volid': '71e24a06-f072-48b4-93e1-60a8b4fee10a', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3496d1-2d89-407a-b45f-c2c7d79c88a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba3496d1-2d89-407a-b45f-c2c7d79c88a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cbffbd-1636-49eb-8dba-dad680db5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Volume 82edc5de-9cc3-45aa-9e71-b33265a6a167: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-82edc5de-9cc3-45aa-9e71-b33265a6a167', 'volume_size': 1, 'source_volid': '71e24a06-f072-48b4-93e1-60a8b4fee10a', 'source_volstatus': 'available'}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:47 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c 1073741824" returned: 0 in 0.707s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:47 devstack sudo[88899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c
Apr 13 17:10:47 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:47 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:47 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b
Apr 13 17:10:47 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:48 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.489s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:48 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Cloning volume 71e24a06-f072-48b4-93e1-60a8b4fee10a to volume 82edc5de-9cc3-45aa-9e71-b33265a6a167
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cba33d7-6f27-43f4-90f5-4b578a548201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa286b56-0037-433f-a29a-8a2ad4f672e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Creating offline snapshot 25b30f14-7265-4340-8d7f-d7acc45bcfc6 of volume 71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:10:48 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Volume volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c (2d00a98c-cf93-41ee-8dee-424cb7867f4c): created successfully
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa286b56-0037-433f-a29a-8a2ad4f672e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (c4b49efd-ecde-4f6f-821b-850f3fd86ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[405659f1-8e9c-4812-a298-eac0e68b81a1]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a71e80fc-977c-459f-b965-fc7cce254195 tempest-VolumesActionsTest-1204892258 None] Created volume successfully.
Apr 13 17:10:48 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a
Apr 13 17:10:48 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:48 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" returned: 0 in 0.479s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-f4c85f0d-e122-48bc-b7e5-9d3880abea4b" released by "delete_volume" :: held 1.024s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Created reservations ['595ef971-c672-4152-a800-1e8f672038cb', '545d4816-e124-4263-b72e-0fe23af6d05b', 'ac35ba77-0fe9-4da3-9ebd-4203ee6c3787', 'db846e8a-474b-4292-9a36-d94179adb128'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:48 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:10:48 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:48 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a" returned: 0 in 0.523s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:48 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 1G
Apr 13 17:10:48 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:48 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Deleted volume successfully.
Apr 13 17:10:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-46cb1bb4-8448-4563-b046-01526445d87b tempest-VolumesCloneTest-1808169514 None] Lock "cinder-f4c85f0d-e122-48bc-b7e5-9d3880abea4b-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:49 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 1G" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e24a06-f072-48b4-93e1-60a8b4fee10a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:49 devstack sudo[88924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e24a06-f072-48b4-93e1-60a8b4fee10a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6
Apr 13 17:10:49 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-75b2559d-3f86-468b-a474-cb5464acc3ca tempest-VolumesActionsTest-1204892258 None] Acquiring lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c" by "attach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-75b2559d-3f86-468b-a474-cb5464acc3ca tempest-VolumesActionsTest-1204892258 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c" acquired by "attach_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-75b2559d-3f86-468b-a474-cb5464acc3ca tempest-VolumesActionsTest-1204892258 None] Attaching volume 2d00a98c-cf93-41ee-8dee-424cb7867f4c to instance 57e20ebd-87aa-4da8-b45b-c9ed1c6dfe45 at mountpoint /dev/vdb on host None.
Apr 13 17:10:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-75b2559d-3f86-468b-a474-cb5464acc3ca tempest-VolumesActionsTest-1204892258 None] Attach volume completed successfully.
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-75b2559d-3f86-468b-a474-cb5464acc3ca tempest-VolumesActionsTest-1204892258 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c" released by "attach_volume" :: held 0.061s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Acquiring lock "cinder-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Lock "cinder-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Acquiring lock "cinder-quobyte-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a186338c-fb04-4924-a3a2-f1b7dd28d306]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:49 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9
Apr 13 17:10:49 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e24a06-f072-48b4-93e1-60a8b4fee10a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:49 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 is being set with open permissions: ugo+rw
Apr 13 17:10:49 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:49 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6
Apr 13 17:10:49 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:50 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:50 devstack sudo[88937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9
Apr 13 17:10:50 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:50 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:50 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.info
Apr 13 17:10:50 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5474f94f-12e3-43e6-b363-e25ce0f4c7f4 tempest-VolumesActionsTest-415035212 None] Terminate volume connection completed successfully.
Apr 13 17:10:50 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:50 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.info" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:50 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.info is being set with open permissions: ugo+rw
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Lock "cinder-quobyte-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9" released by "delete_volume" :: held 1.084s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:50 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.info
Apr 13 17:10:50 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Created reservations ['c8629ccb-8f70-46e2-9531-707865a41fc6', '79d404e5-1f95-4456-a724-be98f0f32c3b', 'f3d90001-6184-48da-a69b-82953536b66d', 'd96b7223-1e01-4c05-a375-7ceb4d0edb2d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5474f94f-12e3-43e6-b363-e25ce0f4c7f4 tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5474f94f-12e3-43e6-b363-e25ce0f4c7f4 tempest-VolumesActionsTest-415035212 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5474f94f-12e3-43e6-b363-e25ce0f4c7f4 tempest-VolumesActionsTest-415035212 None] Detaching volume 2d00a98c-cf93-41ee-8dee-424cb7867f4c from instance 57e20ebd-87aa-4da8-b45b-c9ed1c6dfe45.
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5474f94f-12e3-43e6-b363-e25ce0f4c7f4 tempest-VolumesActionsTest-415035212 None] Detach volume completed successfully.
Apr 13 17:10:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5474f94f-12e3-43e6-b363-e25ce0f4c7f4 tempest-VolumesActionsTest-415035212 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:50 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:10:50 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:51 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.info" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-82edc5de-9cc3-45aa-9e71-b33265a6a167" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-82edc5de-9cc3-45aa-9e71-b33265a6a167" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] snapshot: 25b30f14-7265-4340-8d7f-d7acc45bcfc6, volume: 82edc5de-9cc3-45aa-9e71-b33265a6a167,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9511b2cb-ee57-40e4-aa0c-0c2d5549a2cf]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:51 devstack sudo[88954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6
Apr 13 17:10:51 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:51 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Deleted volume successfully.
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-94f3a4e3-0741-4b8d-8dd7-7bddd08c24e0 tempest-VolumesCloneTest-1808169514 None] Lock "cinder-7a3d4b56-a9f8-4a03-a5c0-78c3ffc50dc9-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-72f13de9-7d99-4a3a-bb0d-cdeb01a75cfc tempest-VolumesActionsTest-1204892258 None] Acquiring lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-detach_volume" by "detach_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-72f13de9-7d99-4a3a-bb0d-cdeb01a75cfc tempest-VolumesActionsTest-1204892258 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:51 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-72f13de9-7d99-4a3a-bb0d-cdeb01a75cfc tempest-VolumesActionsTest-1204892258 None] Volume detach called, but volume not attached.
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-72f13de9-7d99-4a3a-bb0d-cdeb01a75cfc tempest-VolumesActionsTest-1204892258 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-detach_volume" released by "detach_volume" :: held 0.012s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:51 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6" returned: 0 in 0.516s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e24a06-f072-48b4-93e1-60a8b4fee10a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02a8077-4368-4cdc-91d6-1292b40ea62f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:51 devstack sudo[88960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a
Apr 13 17:10:51 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "cinder-quobyte-2d00a98c-cf93-41ee-8dee-424cb7867f4c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-quobyte-2d00a98c-cf93-41ee-8dee-424cb7867f4c" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc609a-2da0-459d-b9bf-637688e82358]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:52 devstack sudo[88962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c
Apr 13 17:10:52 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:52 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a" returned: 0 in 0.655s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:52 devstack sudo[88967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167
Apr 13 17:10:52 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:52 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c" returned: 0 in 0.801s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:53 devstack sudo[88982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c
Apr 13 17:10:53 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:54 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2d00a98c-cf93-41ee-8dee-424cb7867f4c" returned: 0 in 1.204s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-quobyte-2d00a98c-cf93-41ee-8dee-424cb7867f4c" released by "delete_volume" :: held 2.060s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Created reservations ['cebb0332-e53e-442f-b77e-d267ab76df77', 'e9c73756-1b36-43f5-9069-c168db2bcd7d', '3a3d82b0-915d-4ff2-9dd3-a70cd5041dca', '3560dd19-0a62-45da-8731-01c17857051d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:54 devstack sudo[88986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:10:54 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:54 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167" returned: 0 in 2.582s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c91a7-c875-46a5-ba29-f45141167670]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:55 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a
Apr 13 17:10:55 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Flow 'volume_create_manager' (2c9d47a0-34df-4b18-b4a1-b16c2b902d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f9380a-3f3b-42ef-9f2a-f4a16db60f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f9380a-3f3b-42ef-9f2a-f4a16db60f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-621227822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6d5363-86ae-4f39-ad60-65a5d77b6312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fccbc3f3e84bfb80f2b82a2ccd33c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:55Z,use_quota=True,user_id='4d46a2d137d3416099fbefdaa332be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ef2a81-f5d8-413e-802e-077ef7eb0b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ef2a81-f5d8-413e-802e-077ef7eb0b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e001b8b5-5d26-4e8a-a454-70cde994ce75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e001b8b5-5d26-4e8a-a454-70cde994ce75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b6d5363-86ae-4f39-ad60-65a5d77b6312', 'volume_name': 'volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3ac9a9-4bd2-4921-841c-425a43474eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3ac9a9-4bd2-4921-841c-425a43474eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a14584-0bba-4404-a7b2-3e1542af9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Volume 1b6d5363-86ae-4f39-ad60-65a5d77b6312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312', 'volume_size': 2}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:55 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 1.007s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:10:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Deleted volume successfully.
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-325dca39-48f6-4cb3-b0d2-89f88eb562a2 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-2d00a98c-cf93-41ee-8dee-424cb7867f4c-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:55 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a" returned: 0 in 0.824s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a, size 1024.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:10:55 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Converted 1024.00 MB image at 396.12 MB/s
Apr 13 17:10:55 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 is being set with open permissions: ugo+rw
Apr 13 17:10:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:55 devstack sudo[88995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167
Apr 13 17:10:55 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:56 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-82edc5de-9cc3-45aa-9e71-b33265a6a167" released by "_copy_volume_from_snapshot" :: held 5.074s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-25b30f14-7265-4340-8d7f-d7acc45bcfc6" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-25b30f14-7265-4340-8d7f-d7acc45bcfc6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Deleting offline snapshot 25b30f14-7265-4340-8d7f-d7acc45bcfc6 of volume 71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] snapshot_file for this snap is: volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d230c-7c28-422c-af5a-1b3889314d22]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:56 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6
Apr 13 17:10:56 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:56 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e24a06-f072-48b4-93e1-60a8b4fee10a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c161dbb-cc72-41cb-9c51-8a5ce5fc5c6a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:56 devstack sudo[89065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a
Apr 13 17:10:56 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:57 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:57 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6
Apr 13 17:10:57 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:57 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:57 devstack sudo[89077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6
Apr 13 17:10:57 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:58 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a.25b30f14-7265-4340-8d7f-d7acc45bcfc6" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-25b30f14-7265-4340-8d7f-d7acc45bcfc6" released by "_delete_snapshot" :: held 2.002s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.150s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.971s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-621227822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6d5363-86ae-4f39-ad60-65a5d77b6312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fccbc3f3e84bfb80f2b82a2ccd33c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:10:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:10:55Z,use_quota=True,user_id='4d46a2d137d3416099fbefdaa332be85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Creating volume 1b6d5363-86ae-4f39-ad60-65a5d77b6312 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:10:58 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312 2147483648 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0cbffbd-1636-49eb-8dba-dad680db5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82edc5de-9cc3-45aa-9e71-b33265a6a167', 'volume_size': 1, 'source_volid': '71e24a06-f072-48b4-93e1-60a8b4fee10a', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:58 devstack sudo[89080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312 2147483648
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a95a2d-aeb8-46cc-b918-d73b00a21f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:58 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Volume volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 (82edc5de-9cc3-45aa-9e71-b33265a6a167): created successfully
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81a95a2d-aeb8-46cc-b918-d73b00a21f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Flow 'volume_create_manager' (fb04d689-85ba-4f36-82d3-37ff046f8354) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ee55b80c-c47f-404f-831f-dd1a10491f64 tempest-VolumeDependencyTests-1993529670 None] Created volume successfully.
Apr 13 17:10:58 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312 2147483648" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=111,cinder:SELECT=95,cinder:INSERT=28,cinder:DELETE=8 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:10:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:58 devstack sudo[89085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312
Apr 13 17:10:58 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-71e24a06-f072-48b4-93e1-60a8b4fee10a-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-71e24a06-f072-48b4-93e1-60a8b4fee10a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:59 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a14584-0bba-4404-a7b2-3e1542af9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb7f0db-137b-49cb-9cfc-c7ff3d16e161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:10:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Volume volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312 (1b6d5363-86ae-4f39-ad60-65a5d77b6312): created successfully
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb7f0db-137b-49cb-9cfc-c7ff3d16e161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Flow 'volume_create_manager' (2c9d47a0-34df-4b18-b4a1-b16c2b902d8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-71e24a06-f072-48b4-93e1-60a8b4fee10a" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fa6c4e1b-3854-4fcf-9363-365f38475941 tempest-VolumesCloneNegativeTest-270315234 None] Created volume successfully.
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-71e24a06-f072-48b4-93e1-60a8b4fee10a" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a49ce2-8aa6-4580-a1c0-3bb788eaa0c3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:59 devstack sudo[89089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a
Apr 13 17:10:59 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Acquiring lock "cinder-1b6d5363-86ae-4f39-ad60-65a5d77b6312-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Lock "cinder-1b6d5363-86ae-4f39-ad60-65a5d77b6312-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Acquiring lock "cinder-quobyte-1b6d5363-86ae-4f39-ad60-65a5d77b6312" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Lock "cinder-quobyte-1b6d5363-86ae-4f39-ad60-65a5d77b6312" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c80693-c29b-4e12-87ab-b9f0f70c7a24]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:59 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312
Apr 13 17:10:59 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:10:59 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:10:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:10:59 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a
Apr 13 17:10:59 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:00 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:00 devstack sudo[89101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312
Apr 13 17:11:00 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:00 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-71e24a06-f072-48b4-93e1-60a8b4fee10a" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-71e24a06-f072-48b4-93e1-60a8b4fee10a" released by "delete_volume" :: held 0.997s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Created reservations ['ff46f906-663c-42e0-ae1d-036812a51fe8', '1057d299-3f7e-443a-a48d-5a3c8d513c06', '58ea79dd-8b71-425a-8e54-7e68de25b9f8', '738424c2-35bf-41fc-99d2-c7f189af6145'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:00 devstack sudo[89104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:00 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:00 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1b6d5363-86ae-4f39-ad60-65a5d77b6312" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Lock "cinder-quobyte-1b6d5363-86ae-4f39-ad60-65a5d77b6312" released by "delete_volume" :: held 1.042s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Created reservations ['46c39e95-d9a5-4ed9-8f4a-5faa4c17fa95', '19a7bda0-c49a-4835-9b2e-a894fe533f04', '7231dfc4-c572-421a-93dd-0bc40e708a4e', '1ff00262-470e-4c80-8e90-b3c3b0b53d00'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:00 devstack sudo[89107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:00 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:00 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:00 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Deleted volume successfully.
Apr 13 17:11:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-404604c5-ce47-4fc3-987e-8b5c9c3c135d tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-71e24a06-f072-48b4-93e1-60a8b4fee10a-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:01 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Deleted volume successfully.
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-22a90284-317f-40ef-98ef-0b7218472b47 tempest-VolumesCloneNegativeTest-270315234 None] Lock "cinder-1b6d5363-86ae-4f39-ad60-65a5d77b6312-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (99049cba-3fc5-4cc3-8e1e-88fc09c4e85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fc154b-f75e-49fe-8aee-6a8b5a299d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-82edc5de-9cc3-45aa-9e71-b33265a6a167-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fc154b-f75e-49fe-8aee-6a8b5a299d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-410699890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd26c921-9f83-4cef-9b7d-06e2fefffe68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:01Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b2bae-b136-4d2d-8465-7db6a3af8b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (963b2bae-b136-4d2d-8465-7db6a3af8b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc52e225-085d-4a61-994d-fafaa3531d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc52e225-085d-4a61-994d-fafaa3531d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd26c921-9f83-4cef-9b7d-06e2fefffe68', 'volume_name': 'volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7e0f74-ce0d-4163-86cf-3499929dd15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7e0f74-ce0d-4163-86cf-3499929dd15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab750e30-b520-4c6a-8e50-12f41ec4d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Volume bd26c921-9f83-4cef-9b7d-06e2fefffe68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68', 'volume_size': 1}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-410699890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd26c921-9f83-4cef-9b7d-06e2fefffe68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:01Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Creating volume bd26c921-9f83-4cef-9b7d-06e2fefffe68 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:01 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-82edc5de-9cc3-45aa-9e71-b33265a6a167-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:01 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68 1073741824
Apr 13 17:11:01 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-82edc5de-9cc3-45aa-9e71-b33265a6a167" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-82edc5de-9cc3-45aa-9e71-b33265a6a167" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a542c3-03ac-4d42-8d05-49f225e9ec82]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:01 devstack sudo[89114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167
Apr 13 17:11:01 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:01 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68 1073741824" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:02 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68
Apr 13 17:11:02 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:02 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167" returned: 0 in 0.571s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:02 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167
Apr 13 17:11:02 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:02 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68" returned: 0 in 0.582s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab750e30-b520-4c6a-8e50-12f41ec4d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83520ebb-1bc6-4aaa-a94e-ccb0e06db0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:02 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-82edc5de-9cc3-45aa-9e71-b33265a6a167" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-82edc5de-9cc3-45aa-9e71-b33265a6a167" released by "delete_volume" :: held 1.140s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Volume volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68 (bd26c921-9f83-4cef-9b7d-06e2fefffe68): created successfully
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83520ebb-1bc6-4aaa-a94e-ccb0e06db0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (99049cba-3fc5-4cc3-8e1e-88fc09c4e85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f4363c01-9af9-4456-8327-c95fa33e7ffa tempest-VolumesActionsTest-1204892258 None] Created volume successfully.
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Created reservations ['8e6062ec-aa65-4881-a421-d3aac325589e', '90dad12e-b9ef-4078-8996-29f53691af71', '0aa66001-ad9a-41fb-acab-d50c301af873', '95842a0c-c8da-47f9-b985-899328a41c66'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:02 devstack sudo[89128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:02 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:03 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:03 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Deleted volume successfully.
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-793104a0-0d9a-4a75-ae4a-3afffb4fddef tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-82edc5de-9cc3-45aa-9e71-b33265a6a167-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-3f8cd50a-67c1-4126-941e-9b0e57627ef4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-3f8cd50a-67c1-4126-941e-9b0e57627ef4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-bd26c921-9f83-4cef-9b7d-06e2fefffe68-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Lock "cinder-bd26c921-9f83-4cef-9b7d-06e2fefffe68-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "cinder-quobyte-3f8cd50a-67c1-4126-941e-9b0e57627ef4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-3f8cd50a-67c1-4126-941e-9b0e57627ef4" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eca388-b2fe-4b62-87ab-91255d9d7c14]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-quobyte-bd26c921-9f83-4cef-9b7d-06e2fefffe68" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-bd26c921-9f83-4cef-9b7d-06e2fefffe68" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9816966-cac0-4127-9163-0fadf1d6d636]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:03 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4
Apr 13 17:11:03 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:03 devstack sudo[89132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68
Apr 13 17:11:03 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:04 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4" returned: 0 in 0.537s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:04 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68" returned: 0 in 0.527s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:04 devstack sudo[89141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4
Apr 13 17:11:04 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:04 devstack sudo[89142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68
Apr 13 17:11:04 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:04 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f8cd50a-67c1-4126-941e-9b0e57627ef4" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-quobyte-3f8cd50a-67c1-4126-941e-9b0e57627ef4" released by "delete_volume" :: held 1.033s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:04 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bd26c921-9f83-4cef-9b7d-06e2fefffe68" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Created reservations ['ccc86d97-3b20-4fb6-b46c-7c3c74c6d192', '24346b7c-f653-4663-b1e8-47e8dbfb96f7', '136a9fee-4dbd-4c84-9394-5a8a7386c3c1', 'b2520765-4de0-4942-b926-605ca326e043'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-bd26c921-9f83-4cef-9b7d-06e2fefffe68" released by "delete_volume" :: held 1.048s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Created reservations ['9d5fe1f0-8eb2-4c66-989d-054e4f1eb340', '96cc62fc-008c-4ef0-b0a7-106001456d14', 'c7ce97db-7b55-4b3c-9847-76a0cbdfc367', 'eb77dba9-90b7-4024-b1db-382fec41a03c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:04 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:04 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:04 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:04 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Flow 'volume_create_manager' (756d8a8c-8675-462e-a58f-6ee217467ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296b6003-3b9a-499b-8a2a-43d9e0ea449b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296b6003-3b9a-499b-8a2a-43d9e0ea449b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1710207626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9b92c-c329-4142-bead-afda33bf5c9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36452102aac145af92a9a58b0f44e669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:05Z,use_quota=True,user_id='afd8c7f2cf2c444d8e83e6e0e7c1feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c59adc-a179-4f11-b82e-bd170f73ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c59adc-a179-4f11-b82e-bd170f73ba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:04 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9cc6ba-c35a-4782-bda5-6be8588686f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9cc6ba-c35a-4782-bda5-6be8588686f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f9b92c-c329-4142-bead-afda33bf5c9a', 'volume_name': 'volume-34f9b92c-c329-4142-bead-afda33bf5c9a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7539056c-92a8-4e48-a754-599d838ff908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7539056c-92a8-4e48-a754-599d838ff908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97fed05-86bd-4d1c-a751-1c6da298bd70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:05 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Volume 34f9b92c-c329-4142-bead-afda33bf5c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f9b92c-c329-4142-bead-afda33bf5c9a', 'volume_size': 1}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1710207626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f9b92c-c329-4142-bead-afda33bf5c9a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36452102aac145af92a9a58b0f44e669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:05Z,use_quota=True,user_id='afd8c7f2cf2c444d8e83e6e0e7c1feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Creating volume 34f9b92c-c329-4142-bead-afda33bf5c9a {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:05 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:05 devstack sudo[89151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a 1073741824
Apr 13 17:11:05 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:05 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Deleted volume successfully.
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b266d2d7-4506-4560-906c-5abde1ec30e5 tempest-VolumeDependencyTests-1993529670 None] Lock "cinder-3f8cd50a-67c1-4126-941e-9b0e57627ef4-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:05 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Deleted volume successfully.
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-f29f24ed-59ad-436b-916f-b4c5f67c7df2 tempest-VolumesActionsTest-415035212 None] Lock "cinder-bd26c921-9f83-4cef-9b7d-06e2fefffe68-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:05 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a 1073741824" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:05 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a
Apr 13 17:11:05 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:05 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97fed05-86bd-4d1c-a751-1c6da298bd70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f9b92c-c329-4142-bead-afda33bf5c9a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:05 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f234332-c797-4b26-a65c-1892556ace6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:06 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Volume volume-34f9b92c-c329-4142-bead-afda33bf5c9a (34f9b92c-c329-4142-bead-afda33bf5c9a): created successfully
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f234332-c797-4b26-a65c-1892556ace6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Flow 'volume_create_manager' (756d8a8c-8675-462e-a58f-6ee217467ac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c21e8cc0-3a97-4e02-8da0-824402f257e2 tempest-VolumesListTestJSON-573429471 None] Created volume successfully.
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (4286fe49-5c1f-4084-99f4-365d55d4adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e116b0cd-9d15-4194-92d3-1004674769ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e116b0cd-9d15-4194-92d3-1004674769ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-324358871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f153f015-2deb-45e7-9591-fbe3e81d390e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:06Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27e724e-f64b-41e3-a710-3f6dce4a5feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27e724e-f64b-41e3-a710-3f6dce4a5feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ec6262-905a-44c2-af83-73896a5b3667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ec6262-905a-44c2-af83-73896a5b3667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f153f015-2deb-45e7-9591-fbe3e81d390e', 'volume_name': 'volume-f153f015-2deb-45e7-9591-fbe3e81d390e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c0856f-fdcc-4837-83df-9f219fd6f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c0856f-fdcc-4837-83df-9f219fd6f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999e7770-e23d-4c2e-add6-a1ab60235844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:06 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Volume f153f015-2deb-45e7-9591-fbe3e81d390e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f153f015-2deb-45e7-9591-fbe3e81d390e', 'volume_size': 1}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-324358871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f153f015-2deb-45e7-9591-fbe3e81d390e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:06Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Creating volume f153f015-2deb-45e7-9591-fbe3e81d390e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:06 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:06 devstack sudo[89161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e 1073741824
Apr 13 17:11:06 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:06 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e 1073741824" returned: 0 in 0.594s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:06 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e
Apr 13 17:11:06 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:07 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999e7770-e23d-4c2e-add6-a1ab60235844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f153f015-2deb-45e7-9591-fbe3e81d390e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c8ff41-ef25-4854-83ae-226cf372fae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:07 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Volume volume-f153f015-2deb-45e7-9591-fbe3e81d390e (f153f015-2deb-45e7-9591-fbe3e81d390e): created successfully
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c8ff41-ef25-4854-83ae-226cf372fae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (4286fe49-5c1f-4084-99f4-365d55d4adb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a7f880d3-379b-4d1a-978b-cecdf2537915 tempest-VolumesActionsTest-1204892258 None] Created volume successfully.
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Flow 'volume_create_manager' (f5aad4d7-1064-4362-914a-a90844962c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe376d1-99a6-4fc1-920e-5edecdecb980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe376d1-99a6-4fc1-920e-5edecdecb980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-225792924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7154c58-f430-4c45-a76f-ee4258913ab8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36452102aac145af92a9a58b0f44e669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:07Z,use_quota=True,user_id='afd8c7f2cf2c444d8e83e6e0e7c1feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff42a4-417a-41c0-81e0-6abf5e987335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff42a4-417a-41c0-81e0-6abf5e987335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9d80ad-1511-4987-b388-f7d970992249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec9d80ad-1511-4987-b388-f7d970992249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7154c58-f430-4c45-a76f-ee4258913ab8', 'volume_name': 'volume-a7154c58-f430-4c45-a76f-ee4258913ab8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b624b5-d92b-4194-b973-e07241fb81f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b624b5-d92b-4194-b973-e07241fb81f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f693aea1-b8d9-4f12-b632-753714a49e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:07 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Volume a7154c58-f430-4c45-a76f-ee4258913ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7154c58-f430-4c45-a76f-ee4258913ab8', 'volume_size': 1}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-225792924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7154c58-f430-4c45-a76f-ee4258913ab8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36452102aac145af92a9a58b0f44e669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:07Z,use_quota=True,user_id='afd8c7f2cf2c444d8e83e6e0e7c1feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Creating volume a7154c58-f430-4c45-a76f-ee4258913ab8 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:07 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:07 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8 1073741824
Apr 13 17:11:07 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:08 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8 1073741824" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:08 devstack sudo[89174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8
Apr 13 17:11:08 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-f153f015-2deb-45e7-9591-fbe3e81d390e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Lock "cinder-f153f015-2deb-45e7-9591-fbe3e81d390e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-quobyte-f153f015-2deb-45e7-9591-fbe3e81d390e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-f153f015-2deb-45e7-9591-fbe3e81d390e" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e837e2-70f3-4aef-ac5b-c7cdd5be78f7]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:08 devstack sudo[89176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e
Apr 13 17:11:08 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:08 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8" returned: 0 in 0.554s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f693aea1-b8d9-4f12-b632-753714a49e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7154c58-f430-4c45-a76f-ee4258913ab8', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e693c1ea-058e-4d44-b982-b259b5088df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Volume volume-a7154c58-f430-4c45-a76f-ee4258913ab8 (a7154c58-f430-4c45-a76f-ee4258913ab8): created successfully
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e693c1ea-058e-4d44-b982-b259b5088df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Flow 'volume_create_manager' (f5aad4d7-1064-4362-914a-a90844962c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-69bdcfee-9aca-4962-a5bc-b5ccf7db7b5e tempest-VolumesListTestJSON-573429471 None] Created volume successfully.
Apr 13 17:11:08 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e" returned: 0 in 0.549s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:08 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e
Apr 13 17:11:08 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:09 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f153f015-2deb-45e7-9591-fbe3e81d390e" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-f153f015-2deb-45e7-9591-fbe3e81d390e" released by "delete_volume" :: held 0.994s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Created reservations ['dfd7fa8d-2f89-47a0-b6c7-cb5860830fc2', '330cce5a-1fcf-4a81-bac7-72356ba38554', 'b36a6cdc-cfb1-4316-832c-fc487d762ade', '0bd2539c-ab0e-4734-a04b-bda6b607b595'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:09 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:09 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Flow 'volume_create_manager' (65c3f160-acbf-4b02-b359-8a7953041809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44730002-1bec-4dd7-8fd0-205ed096e609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44730002-1bec-4dd7-8fd0-205ed096e609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-146861922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe200c-fd33-4ca4-9a20-4f9120a2dc48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36452102aac145af92a9a58b0f44e669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:10Z,use_quota=True,user_id='afd8c7f2cf2c444d8e83e6e0e7c1feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f74cd8-e734-4eb1-be6b-09d8a1bf69c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f74cd8-e734-4eb1-be6b-09d8a1bf69c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffb9465-e4a8-4727-83a2-3136ce4bb44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffb9465-e4a8-4727-83a2-3136ce4bb44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fe200c-fd33-4ca4-9a20-4f9120a2dc48', 'volume_name': 'volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb6c2f6-440f-498e-a487-8b72f9e08aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb6c2f6-440f-498e-a487-8b72f9e08aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8f52ab-d012-437a-9fad-ea500d27c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Volume 95fe200c-fd33-4ca4-9a20-4f9120a2dc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48', 'volume_size': 1}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-146861922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe200c-fd33-4ca4-9a20-4f9120a2dc48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36452102aac145af92a9a58b0f44e669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:10Z,use_quota=True,user_id='afd8c7f2cf2c444d8e83e6e0e7c1feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Creating volume 95fe200c-fd33-4ca4-9a20-4f9120a2dc48 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:09 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:10 devstack sudo[89189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48 1073741824
Apr 13 17:11:10 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:10 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.582s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Deleted volume successfully.
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d61ad958-5f4c-4beb-8daf-89cf3c1e8646 tempest-VolumesActionsTest-415035212 None] Lock "cinder-f153f015-2deb-45e7-9591-fbe3e81d390e-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:10 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48 1073741824" returned: 0 in 0.603s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:10 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48
Apr 13 17:11:10 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (db2ff694-1002-480a-b73e-1ab464a87479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b53863-cc52-4189-8289-588b34ea4faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b53863-cc52-4189-8289-588b34ea4faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1636275210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94312c5-bd81-4479-b933-12ece3f69c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:11Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26c9c4d-b470-458c-b1aa-85e8fd206567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26c9c4d-b470-458c-b1aa-85e8fd206567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1fd046-5f5b-47d2-9359-21a4ecb6b637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1fd046-5f5b-47d2-9359-21a4ecb6b637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94312c5-bd81-4479-b933-12ece3f69c07', 'volume_name': 'volume-d94312c5-bd81-4479-b933-12ece3f69c07', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c049e2a-82d1-412c-95f0-c3a46a15c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c049e2a-82d1-412c-95f0-c3a46a15c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b2f643-22a0-46d0-93ef-0c3be8116e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Volume d94312c5-bd81-4479-b933-12ece3f69c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94312c5-bd81-4479-b933-12ece3f69c07', 'volume_size': 1}
Apr 13 17:11:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:11 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48" returned: 0 in 0.579s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1636275210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94312c5-bd81-4479-b933-12ece3f69c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:11Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Creating volume d94312c5-bd81-4479-b933-12ece3f69c07 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:11 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8f52ab-d012-437a-9fad-ea500d27c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21328d7e-8d5d-4695-a6d1-c320c2b87a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:11 devstack sudo[89197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07 1073741824
Apr 13 17:11:11 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Volume volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48 (95fe200c-fd33-4ca4-9a20-4f9120a2dc48): created successfully
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21328d7e-8d5d-4695-a6d1-c320c2b87a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Flow 'volume_create_manager' (65c3f160-acbf-4b02-b359-8a7953041809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-aed693fa-64e7-46a1-a574-0eca579dd513 tempest-VolumesListTestJSON-573429471 None] Created volume successfully.
Apr 13 17:11:11 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07 1073741824" returned: 0 in 0.611s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:11 devstack sudo[89202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07
Apr 13 17:11:11 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:12 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b2f643-22a0-46d0-93ef-0c3be8116e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94312c5-bd81-4479-b933-12ece3f69c07', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2329b89e-825b-48cd-8496-0662089a40e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Volume volume-d94312c5-bd81-4479-b933-12ece3f69c07 (d94312c5-bd81-4479-b933-12ece3f69c07): created successfully
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2329b89e-825b-48cd-8496-0662089a40e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (db2ff694-1002-480a-b73e-1ab464a87479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1d4434a9-c038-4ef2-ac12-b13580e42726 tempest-VolumesActionsTest-1204892258 None] Created volume successfully.
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:12 devstack sudo[89205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:12 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:13 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.524s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-d94312c5-bd81-4479-b933-12ece3f69c07-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Lock "cinder-d94312c5-bd81-4479-b933-12ece3f69c07-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-quobyte-d94312c5-bd81-4479-b933-12ece3f69c07" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-d94312c5-bd81-4479-b933-12ece3f69c07" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db01a6-2273-4d79-ba59-15d6ab794f51]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:13 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07
Apr 13 17:11:13 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:13 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:13 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07
Apr 13 17:11:13 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Acquiring lock "cinder-95fe200c-fd33-4ca4-9a20-4f9120a2dc48-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Lock "cinder-95fe200c-fd33-4ca4-9a20-4f9120a2dc48-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:13 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=123,cinder:UPDATE=168,cinder:INSERT=43,cinder:DELETE=15 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Acquiring lock "cinder-quobyte-95fe200c-fd33-4ca4-9a20-4f9120a2dc48" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Lock "cinder-quobyte-95fe200c-fd33-4ca4-9a20-4f9120a2dc48" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[653cffeb-1d5a-43ca-ab18-f56bc8e5f97b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:14 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48
Apr 13 17:11:14 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:14 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-d94312c5-bd81-4479-b933-12ece3f69c07" returned: 0 in 0.553s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-d94312c5-bd81-4479-b933-12ece3f69c07" released by "delete_volume" :: held 1.142s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Created reservations ['fdebee1a-0ac0-4b13-b314-e7ae843a3a48', '15edabb7-f31e-4eb1-ad10-cfc6980a3452', 'f7cd67e3-1798-4ae5-88dc-3e78e9f9b957', 'd1600605-32c4-4366-a1fb-8cdbfbfd840e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:14 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:14 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:14 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48" returned: 0 in 0.586s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:14 devstack sudo[89223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48
Apr 13 17:11:14 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:14 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Deleted volume successfully.
Apr 13 17:11:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1aaad45e-0c97-402e-be53-e01922dfa55b tempest-VolumesActionsTest-415035212 None] Lock "cinder-d94312c5-bd81-4479-b933-12ece3f69c07-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:15 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-95fe200c-fd33-4ca4-9a20-4f9120a2dc48" returned: 0 in 0.527s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Lock "cinder-quobyte-95fe200c-fd33-4ca4-9a20-4f9120a2dc48" released by "delete_volume" :: held 1.149s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Created reservations ['419d8c67-0f06-4b72-9b51-acb4a32f749e', '3ad12167-e2a1-471c-a6d6-fcb4145a3ef3', 'f616d226-a36b-4be6-8742-767e580b0e34', '6d3faaaa-564a-477c-a8cb-70056c44db33'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:15 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:15 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (4166659b-5c9c-4bfb-9b9a-8e28a4d30ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032ff93-b11d-4c6b-9ae8-7e5ea8ed4a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1032ff93-b11d-4c6b-9ae8-7e5ea8ed4a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1546394964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4527fb-d287-4f3c-8157-6a325641145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:16Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c0ff80-7678-4b61-926b-dc884b4b3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c0ff80-7678-4b61-926b-dc884b4b3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a1fb50-2e3f-4792-aeca-543999149ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a1fb50-2e3f-4792-aeca-543999149ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4527fb-d287-4f3c-8157-6a325641145c', 'volume_name': 'volume-3b4527fb-d287-4f3c-8157-6a325641145c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d70f8a5-8a14-494d-b590-e57b8266d1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d70f8a5-8a14-494d-b590-e57b8266d1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24569d0e-3c33-466b-8391-69d393986fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Volume 3b4527fb-d287-4f3c-8157-6a325641145c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4527fb-d287-4f3c-8157-6a325641145c', 'volume_size': 1}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1546394964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4527fb-d287-4f3c-8157-6a325641145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:16Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Creating volume 3b4527fb-d287-4f3c-8157-6a325641145c {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:15 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:15 devstack sudo[89230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c 1073741824
Apr 13 17:11:15 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:15 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Deleted volume successfully.
Apr 13 17:11:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf15bf90-337f-48af-920a-f0b89f9c5c20 tempest-VolumesListTestJSON-573429471 None] Lock "cinder-95fe200c-fd33-4ca4-9a20-4f9120a2dc48-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Acquiring lock "cinder-a7154c58-f430-4c45-a76f-ee4258913ab8-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Lock "cinder-a7154c58-f430-4c45-a76f-ee4258913ab8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Acquiring lock "cinder-quobyte-a7154c58-f430-4c45-a76f-ee4258913ab8" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Lock "cinder-quobyte-a7154c58-f430-4c45-a76f-ee4258913ab8" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6397397-f17a-4bd2-8290-fe8110fc118b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:16 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c 1073741824" returned: 0 in 0.592s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:16 devstack sudo[89236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c
Apr 13 17:11:16 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:16 devstack sudo[89235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8
Apr 13 17:11:16 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:16 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24569d0e-3c33-466b-8391-69d393986fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4527fb-d287-4f3c-8157-6a325641145c', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef980097-4d00-4ea2-9804-20a8d5ff14bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:16 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8" returned: 0 in 0.526s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:16 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Volume volume-3b4527fb-d287-4f3c-8157-6a325641145c (3b4527fb-d287-4f3c-8157-6a325641145c): created successfully
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef980097-4d00-4ea2-9804-20a8d5ff14bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:16 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8
Apr 13 17:11:16 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:16 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (4166659b-5c9c-4bfb-9b9a-8e28a4d30ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c83fda88-33a3-4275-baa2-6cd87dbcec9b tempest-VolumesActionsTest-1204892258 None] Created volume successfully.
Apr 13 17:11:17 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a7154c58-f430-4c45-a76f-ee4258913ab8" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Lock "cinder-quobyte-a7154c58-f430-4c45-a76f-ee4258913ab8" released by "delete_volume" :: held 0.998s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Created reservations ['3f06dc6c-db12-48cd-8db8-6456d0902ab5', '86adff04-d2f0-4079-b39b-eb36ebe3bd03', 'c10a8155-8a7a-49ae-acd9-5ca82b75e711', '060186f9-c9f8-46cf-8eb9-0886ef800c2b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:17 devstack sudo[89247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:17 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Acquiring lock "cinder-34f9b92c-c329-4142-bead-afda33bf5c9a-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Lock "cinder-34f9b92c-c329-4142-bead-afda33bf5c9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Acquiring lock "cinder-quobyte-34f9b92c-c329-4142-bead-afda33bf5c9a" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Lock "cinder-quobyte-34f9b92c-c329-4142-bead-afda33bf5c9a" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b06b44-3b24-4f60-bff0-1534d1b50811]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:17 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Deleted volume successfully.
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-03d93c60-9e1f-437c-8317-51e6317d55bb tempest-VolumesListTestJSON-573429471 None] Lock "cinder-a7154c58-f430-4c45-a76f-ee4258913ab8-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:17 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a
Apr 13 17:11:17 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-3b4527fb-d287-4f3c-8157-6a325641145c-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Lock "cinder-3b4527fb-d287-4f3c-8157-6a325641145c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Acquiring lock "cinder-quobyte-3b4527fb-d287-4f3c-8157-6a325641145c" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-3b4527fb-d287-4f3c-8157-6a325641145c" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e7265f-85c2-48eb-80b0-bd14f8914a05]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:18 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c
Apr 13 17:11:18 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:18 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:18 devstack sudo[89257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a
Apr 13 17:11:18 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:18 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c" returned: 0 in 0.581s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:18 devstack sudo[89262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c
Apr 13 17:11:18 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:18 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-34f9b92c-c329-4142-bead-afda33bf5c9a" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Lock "cinder-quobyte-34f9b92c-c329-4142-bead-afda33bf5c9a" released by "delete_volume" :: held 0.989s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Created reservations ['dc24c695-84b5-4957-9604-3ae0d36b365d', '52b82ccc-9c14-4164-94ba-6be3719c54d7', 'd50ccd40-496f-4726-8b12-f1fb0f62f747', 'd0ed4e63-eb3d-46c4-9a0f-8a8d048a2b78'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:18 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:18 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:19 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3b4527fb-d287-4f3c-8157-6a325641145c" returned: 0 in 0.489s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Lock "cinder-quobyte-3b4527fb-d287-4f3c-8157-6a325641145c" released by "delete_volume" :: held 1.094s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Created reservations ['cfb8d2b2-7382-434c-9e39-8cf17b837a93', 'b9a360bc-96d2-4468-a30f-bfaff795b412', '128570ec-ff54-4e3d-8b37-cabda7a5d79b', '480ecbc9-0ad8-4532-90af-d368c73d6ae5'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:19 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:19 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:19 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Deleted volume successfully.
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4f3b5bc-eef3-41b6-a6df-445ba4606b9e tempest-VolumesListTestJSON-573429471 None] Lock "cinder-34f9b92c-c329-4142-bead-afda33bf5c9a-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:19 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Deleted volume successfully.
Apr 13 17:11:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0c21a24d-b7ac-4391-8a67-d01eafc0cb5d tempest-VolumesActionsTest-415035212 None] Lock "cinder-3b4527fb-d287-4f3c-8157-6a325641145c-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (0a1fbc9c-d4d5-4655-911e-9a034367f18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa6a078-da0a-4b56-9938-7c8c20732852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa6a078-da0a-4b56-9938-7c8c20732852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2056516773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00b8a80-b935-4307-b817-a0c978f9d88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:20Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c132cd5-25d4-47d6-9f06-77a7b4242389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c132cd5-25d4-47d6-9f06-77a7b4242389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad63de0-0eff-4bab-b7f6-71130610f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad63de0-0eff-4bab-b7f6-71130610f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00b8a80-b935-4307-b817-a0c978f9d88f', 'volume_name': 'volume-f00b8a80-b935-4307-b817-a0c978f9d88f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924f50c5-4d2a-406a-8560-11d8070fca05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924f50c5-4d2a-406a-8560-11d8070fca05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a0d91-4ddd-4082-ba21-9276bf54d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:20 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Volume f00b8a80-b935-4307-b817-a0c978f9d88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00b8a80-b935-4307-b817-a0c978f9d88f', 'volume_size': 1}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2056516773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00b8a80-b935-4307-b817-a0c978f9d88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f680c7b604c4764ac5a0bb7ea367b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:20Z,use_quota=True,user_id='1e1fe56811d5437ebbbf84017fbb519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Creating volume f00b8a80-b935-4307-b817-a0c978f9d88f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:20 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:20 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f 1073741824
Apr 13 17:11:20 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:21 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f 1073741824" returned: 0 in 0.711s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:21 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f
Apr 13 17:11:21 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:21 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a0d91-4ddd-4082-ba21-9276bf54d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00b8a80-b935-4307-b817-a0c978f9d88f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fbe343-126e-4966-af57-0a913ea280d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Volume volume-f00b8a80-b935-4307-b817-a0c978f9d88f (f00b8a80-b935-4307-b817-a0c978f9d88f): created successfully
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37fbe343-126e-4966-af57-0a913ea280d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Flow 'volume_create_manager' (0a1fbc9c-d4d5-4655-911e-9a034367f18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Flow 'volume_create_manager' (6e94df18-1317-453d-bfbe-051f0882b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e160126-c19f-4030-bb0a-c1e96752fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-01cf6220-71e2-4afc-8215-77db65225119 tempest-VolumesActionsTest-1204892258 None] Created volume successfully.
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e160126-c19f-4030-bb0a-c1e96752fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8718d4b0-ce40-4dde-a588-451ff19f131e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42891c1aa29b4fadb26a85e8af437560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:22Z,use_quota=True,user_id='2d7af0fdedef41bfa75664e274aa61cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8bdf9d-9754-4bd1-b857-aba2bb3fd7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8bdf9d-9754-4bd1-b857-aba2bb3fd7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd0fae3-dbd9-4903-b00e-e359cb757729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd0fae3-dbd9-4903-b00e-e359cb757729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8718d4b0-ce40-4dde-a588-451ff19f131e', 'volume_name': 'volume-8718d4b0-ce40-4dde-a588-451ff19f131e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c14a289-19a2-4fdc-8b88-f46b173b9d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c14a289-19a2-4fdc-8b88-f46b173b9d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e7370c-b97e-41af-97a2-2da80697dcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Volume 8718d4b0-ce40-4dde-a588-451ff19f131e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8718d4b0-ce40-4dde-a588-451ff19f131e', 'volume_size': 1}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8718d4b0-ce40-4dde-a588-451ff19f131e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42891c1aa29b4fadb26a85e8af437560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:22Z,use_quota=True,user_id='2d7af0fdedef41bfa75664e274aa61cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Creating volume 8718d4b0-ce40-4dde-a588-451ff19f131e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:21 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:21 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e 1073741824
Apr 13 17:11:21 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:22 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e 1073741824" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:22 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e
Apr 13 17:11:22 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:23 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e7370c-b97e-41af-97a2-2da80697dcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8718d4b0-ce40-4dde-a588-451ff19f131e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fbfdfe-c0f8-4ea9-9c87-d73b5fdf9f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Volume volume-8718d4b0-ce40-4dde-a588-451ff19f131e (8718d4b0-ce40-4dde-a588-451ff19f131e): created successfully
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fbfdfe-c0f8-4ea9-9c87-d73b5fdf9f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Flow 'volume_create_manager' (6e94df18-1317-453d-bfbe-051f0882b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-57fe10be-7dea-47a3-98d4-034c0bab2269 tempest-CinderUnicodeTest-1268204903 None] Created volume successfully.
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "cinder-f00b8a80-b935-4307-b817-a0c978f9d88f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-f00b8a80-b935-4307-b817-a0c978f9d88f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "cinder-quobyte-f00b8a80-b935-4307-b817-a0c978f9d88f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-quobyte-f00b8a80-b935-4307-b817-a0c978f9d88f" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8900a8c7-a999-4d68-b6bf-a822a94787b6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:23 devstack sudo[89290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f
Apr 13 17:11:23 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Flow 'volume_create_manager' (749d501e-e557-4d28-8725-b419c745b58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470368a6-6e18-4290-8835-d6240213929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470368a6-6e18-4290-8835-d6240213929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-980506071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b11470-ab51-4c68-b104-71c2e9b481b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651738409a1e4e5abe4aecc58d6c2224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:23Z,use_quota=True,user_id='3c47dff5f16e4a04ba4411d8599dad17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f3b89e-0bea-4cec-aa73-230b027531cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f3b89e-0bea-4cec-aa73-230b027531cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644955fe-eb21-4b37-8bcd-392f10d48bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644955fe-eb21-4b37-8bcd-392f10d48bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b11470-ab51-4c68-b104-71c2e9b481b4', 'volume_name': 'volume-64b11470-ab51-4c68-b104-71c2e9b481b4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbad138-7e17-4b67-93ef-d04eb099156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbad138-7e17-4b67-93ef-d04eb099156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c1df15-3e08-4cf7-883d-069202660f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:23 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Volume 64b11470-ab51-4c68-b104-71c2e9b481b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b11470-ab51-4c68-b104-71c2e9b481b4', 'volume_size': 1}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-980506071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b11470-ab51-4c68-b104-71c2e9b481b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651738409a1e4e5abe4aecc58d6c2224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:23Z,use_quota=True,user_id='3c47dff5f16e4a04ba4411d8599dad17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Creating volume 64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:23 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:23 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 1073741824
Apr 13 17:11:23 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:23 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:23 devstack sudo[89297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f
Apr 13 17:11:23 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:23 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 1073741824" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:24 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4
Apr 13 17:11:24 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:24 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f00b8a80-b935-4307-b817-a0c978f9d88f" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-quobyte-f00b8a80-b935-4307-b817-a0c978f9d88f" released by "delete_volume" :: held 0.989s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Created reservations ['31997cc6-3614-4dc5-b280-da62810c0002', '635c27b1-99ae-48d0-a5af-fa396d1008f0', 'ee344719-926b-4f5a-8c14-a46d49ba0c51', 'ef66c141-2fe6-423c-bba8-7126db742e33'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:24 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:24 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Flow 'volume_create_manager' (2e8b2341-3ef7-4055-830f-320da4b875d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eefb77-1072-4120-8705-d77994002e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eefb77-1072-4120-8705-d77994002e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-578186124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42891c1aa29b4fadb26a85e8af437560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:24Z,use_quota=True,user_id='2d7af0fdedef41bfa75664e274aa61cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6897ee4-eb77-49fb-af48-25ccc0573546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6897ee4-eb77-49fb-af48-25ccc0573546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7134874b-ac94-4f42-a3dd-1d27a03f4849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7134874b-ac94-4f42-a3dd-1d27a03f4849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7', 'volume_name': 'volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3c62da-2bdb-4619-90f2-230fbda40a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc3c62da-2bdb-4619-90f2-230fbda40a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80265ea-566b-41ad-9725-43f474689df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Volume 72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7', 'volume_size': 1}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:24 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4" returned: 0 in 0.472s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-578186124',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42891c1aa29b4fadb26a85e8af437560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:24Z,use_quota=True,user_id='2d7af0fdedef41bfa75664e274aa61cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Creating volume 72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:24 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c1df15-3e08-4cf7-883d-069202660f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b11470-ab51-4c68-b104-71c2e9b481b4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a18a6b6-cb69-46db-b430-0c5f91e64f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:24 devstack sudo[89308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 1073741824
Apr 13 17:11:24 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:24 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Volume volume-64b11470-ab51-4c68-b104-71c2e9b481b4 (64b11470-ab51-4c68-b104-71c2e9b481b4): created successfully
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a18a6b6-cb69-46db-b430-0c5f91e64f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Flow 'volume_create_manager' (749d501e-e557-4d28-8725-b419c745b58e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b204a457-7c10-42c0-a841-292ed4d98f66 tempest-SnapshotDependencyTests-862241137 None] Created volume successfully.
Apr 13 17:11:24 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Deleted volume successfully.
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5e110cde-ffee-400c-9bcf-822dde4c6772 tempest-VolumesActionsTest-1204892258 None] Lock "cinder-f00b8a80-b935-4307-b817-a0c978f9d88f-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:24 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 1073741824" returned: 0 in 0.470s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:25 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7
Apr 13 17:11:25 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:25 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80265ea-566b-41ad-9725-43f474689df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653162d5-8c98-4efe-8e0e-ac89d51a9c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Volume volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 (72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7): created successfully
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653162d5-8c98-4efe-8e0e-ac89d51a9c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Flow 'volume_create_manager' (2e8b2341-3ef7-4055-830f-320da4b875d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-da81efaa-0018-4e3c-8eed-e6cb86ebf6a9 tempest-CinderUnicodeTest-1268204903 None] Created volume successfully.
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Creating offline snapshot ca7c1575-b233-4a8a-9a2b-bc7f111195a6 of volume 64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d994c9-7986-4542-9c8e-a3cb7c5359f4]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:25 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4
Apr 13 17:11:25 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:26 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4" returned: 0 in 0.517s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:26 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 1G
Apr 13 17:11:26 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:26 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 1G" returned: 0 in 0.589s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b11470-ab51-4c68-b104-71c2e9b481b4 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:26 devstack sudo[89328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b11470-ab51-4c68-b104-71c2e9b481b4 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6
Apr 13 17:11:26 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:27 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64b11470-ab51-4c68-b104-71c2e9b481b4 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:27 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 is being set with open permissions: ugo+rw
Apr 13 17:11:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:27 devstack sudo[89333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6
Apr 13 17:11:27 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:27 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:27 devstack sudo[89337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.info
Apr 13 17:11:27 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:28 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.info" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:28 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.info is being set with open permissions: ugo+rw
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:28 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.info
Apr 13 17:11:28 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:28 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.info" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.109s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Creating offline snapshot 6d73d23f-13ce-4a7e-a9fa-f55edea37f03 of volume 72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:11:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e9014284-7f8a-445d-83a5-e807df399e4a tempest-SnapshotDependencyTests-862241137 None] Create snapshot completed successfully
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[63508927-26fa-4654-b7e2-4f45650e794b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:28 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7
Apr 13 17:11:28 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Flow 'volume_create_manager' (3cb323aa-b771-4ec4-8b08-a6e2f6af85db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa66d2f3-e005-4463-ac90-74972649a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa66d2f3-e005-4463-ac90-74972649a36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d9cae2-fc15-4fc8-8599-f9f8657e453d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651738409a1e4e5abe4aecc58d6c2224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca7c1575-b233-4a8a-9a2b-bc7f111195a6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:29Z,use_quota=True,user_id='3c47dff5f16e4a04ba4411d8599dad17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f809abfe-0a86-41e5-86f3-ded35311d562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f809abfe-0a86-41e5-86f3-ded35311d562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00025fb-09b0-463f-8f23-2c915bf89a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00025fb-09b0-463f-8f23-2c915bf89a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78d9cae2-fc15-4fc8-8599-f9f8657e453d', 'volume_name': 'volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d', 'volume_size': 1, 'snapshot_id': 'ca7c1575-b233-4a8a-9a2b-bc7f111195a6'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e379f4df-43bb-41c6-8edb-d4f9b34c4048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e379f4df-43bb-41c6-8edb-d4f9b34c4048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2977b9-f3b7-4912-954d-14cc3beb29e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Volume 78d9cae2-fc15-4fc8-8599-f9f8657e453d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d', 'volume_size': 1, 'snapshot_id': 'ca7c1575-b233-4a8a-9a2b-bc7f111195a6'}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:29 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:29 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 1G
Apr 13 17:11:29 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:29 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 1G" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:29 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03
Apr 13 17:11:29 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:30 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03" returned: 0 in 0.495s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:30 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 is being set with open permissions: ugo+rw
Apr 13 17:11:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:30 devstack sudo[89361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03
Apr 13 17:11:30 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:30 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:30 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.info
Apr 13 17:11:30 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:31 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.info" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:31 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.info is being set with open permissions: ugo+rw
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:31 devstack sudo[89367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.info
Apr 13 17:11:31 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:31 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.info" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.072s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.540s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-quobyte-ca7c1575-b233-4a8a-9a2b-bc7f111195a6-78d9cae2-fc15-4fc8-8599-f9f8657e453d" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-aef7d79b-d187-4e51-b7aa-71e001a511a4 tempest-CinderUnicodeTest-1268204903 None] Create snapshot completed successfully
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-ca7c1575-b233-4a8a-9a2b-bc7f111195a6-78d9cae2-fc15-4fc8-8599-f9f8657e453d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Creating volume 78d9cae2-fc15-4fc8-8599-f9f8657e453d from snapshot ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-quobyte-78d9cae2-fc15-4fc8-8599-f9f8657e453d" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-78d9cae2-fc15-4fc8-8599-f9f8657e453d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] snapshot: ca7c1575-b233-4a8a-9a2b-bc7f111195a6, volume: 78d9cae2-fc15-4fc8-8599-f9f8657e453d,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcd8a34-2af0-41e6-953b-20f394dc1e53]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:31 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6
Apr 13 17:11:31 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:32 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b11470-ab51-4c68-b104-71c2e9b481b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b509114-c046-4502-895a-7001eb3d971f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:32 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4
Apr 13 17:11:32 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "cinder-6d73d23f-13ce-4a7e-a9fa-f55edea37f03-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-6d73d23f-13ce-4a7e-a9fa-f55edea37f03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "cinder-quobyte-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "cinder-quobyte-6d73d23f-13ce-4a7e-a9fa-f55edea37f03" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Flow 'volume_create_manager' (93985d26-94eb-4e1e-af91-99b35c0a95f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d97b2b-514b-401d-992a-f436f5df53d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-6d73d23f-13ce-4a7e-a9fa-f55edea37f03" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Deleting offline snapshot 6d73d23f-13ce-4a7e-a9fa-f55edea37f03 of volume 72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:11:32 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] snapshot_file for this snap is: volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18d97b2b-514b-401d-992a-f436f5df53d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1027159983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b119b5-fe07-4c36-9fc1-5c3000bcce62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bba854e9d4b420cad162356afe2a0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:33Z,use_quota=True,user_id='7ef185a2fabc4891a047e314b43d7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f5d41f-acfb-4ade-b509-cd1c310ecffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f5d41f-acfb-4ade-b509-cd1c310ecffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe52336-a473-4d4b-bacb-a76290715c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe52336-a473-4d4b-bacb-a76290715c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b119b5-fe07-4c36-9fc1-5c3000bcce62', 'volume_name': 'volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9323dd-1e49-4983-bc8b-92370ad61088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f9323dd-1e49-4983-bc8b-92370ad61088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d64ea9b-f4a2-45a5-a50f-a487995d4fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:32 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Volume 31b119b5-fe07-4c36-9fc1-5c3000bcce62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62', 'volume_size': 1}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[88463953-455f-46ff-8ed1-64effa6b7b3d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4" returned: 0 in 0.570s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:11:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:32 devstack sudo[89381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d
Apr 13 17:11:32 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:33 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03
Apr 13 17:11:33 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:33 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:11:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e096837-72eb-4e83-bd32-bedc3240c219]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:33 devstack sudo[89397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7
Apr 13 17:11:33 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:34 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" returned: 0 in 1.263s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:34 devstack sudo[89402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03
Apr 13 17:11:34 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:34 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d" returned: 0 in 1.948s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:34 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[546817de-19a8-45fe-b344-40e3515ce59c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:35 devstack sudo[89404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4
Apr 13 17:11:35 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:35 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03" returned: 0 in 0.528s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:35 devstack sudo[89409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03
Apr 13 17:11:35 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:35 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4" returned: 0 in 0.615s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:11:35 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Converted 1024.00 MB image at 525.30 MB/s
Apr 13 17:11:35 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d is being set with open permissions: ugo+rw
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:35 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d
Apr 13 17:11:35 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:35 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7.6d73d23f-13ce-4a7e-a9fa-f55edea37f03" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-6d73d23f-13ce-4a7e-a9fa-f55edea37f03" released by "_delete_snapshot" :: held 2.789s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" released by "delete_snapshot" :: held 2.840s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Created reservations ['7881142c-353b-4564-9ccf-43c68838da3f', '528a1549-9960-4c3e-b843-c5fd2f2231fe', '5ad49bff-cf8a-41f8-a384-58dd6fd964c8', '97ae6a5c-d732-4185-bff2-4a00328748be'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:35 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Delete snapshot completed successfully.
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2c3c9268-042c-4dd4-bc57-0f23efc445f1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-6d73d23f-13ce-4a7e-a9fa-f55edea37f03-delete_snapshot" released by "delete_snapshot" :: held 2.931s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:35 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-78d9cae2-fc15-4fc8-8599-f9f8657e453d" released by "_copy_volume_from_snapshot" :: held 4.143s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-ca7c1575-b233-4a8a-9a2b-bc7f111195a6-78d9cae2-fc15-4fc8-8599-f9f8657e453d" released by "_create_volume_from_snapshot" :: held 4.165s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.188s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.035s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1027159983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b119b5-fe07-4c36-9fc1-5c3000bcce62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bba854e9d4b420cad162356afe2a0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:33Z,use_quota=True,user_id='7ef185a2fabc4891a047e314b43d7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Creating volume 31b119b5-fe07-4c36-9fc1-5c3000bcce62 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:35 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:36 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:36 devstack sudo[89418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62 1073741824
Apr 13 17:11:36 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "cinder-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2977b9-f3b7-4912-954d-14cc3beb29e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d', 'volume_size': 1, 'snapshot_id': 'ca7c1575-b233-4a8a-9a2b-bc7f111195a6'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2bc7ee-d665-4059-ba29-51fccde59b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "cinder-quobyte-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Volume volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d (78d9cae2-fc15-4fc8-8599-f9f8657e453d): created successfully
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2bc7ee-d665-4059-ba29-51fccde59b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Flow 'volume_create_manager' (3cb323aa-b771-4ec4-8b08-a6e2f6af85db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" acquired by "delete_volume" :: waited 0.020s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9158f875-c9be-4d0f-adca-757461b7a39a tempest-SnapshotDependencyTests-862241137 None] Created volume successfully.
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ac0868-c9ba-4f62-b554-67f791bf176e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:36 devstack sudo[89420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7
Apr 13 17:11:36 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:36 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62 1073741824" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:36 devstack sudo[89426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62
Apr 13 17:11:36 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:36 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" returned: 0 in 0.499s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:36 devstack sudo[89430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7
Apr 13 17:11:36 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-ca7c1575-b233-4a8a-9a2b-bc7f111195a6-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-ca7c1575-b233-4a8a-9a2b-bc7f111195a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-quobyte-64b11470-ab51-4c68-b104-71c2e9b481b4" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-64b11470-ab51-4c68-b104-71c2e9b481b4" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-quobyte-ca7c1575-b233-4a8a-9a2b-bc7f111195a6" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-ca7c1575-b233-4a8a-9a2b-bc7f111195a6" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Deleting offline snapshot ca7c1575-b233-4a8a-9a2b-bc7f111195a6 of volume 64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] snapshot_file for this snap is: volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eb5999-7308-46bf-bfd2-68fd5b9a1098]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:36 devstack sudo[89432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6
Apr 13 17:11:36 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:36 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d64ea9b-f4a2-45a5-a50f-a487995d4fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0e4150-319f-46e3-b8cf-a7b5f3dd70a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Volume volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62 (31b119b5-fe07-4c36-9fc1-5c3000bcce62): created successfully
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0e4150-319f-46e3-b8cf-a7b5f3dd70a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Flow 'volume_create_manager' (93985d26-94eb-4e1e-af91-99b35c0a95f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d31e89cf-17a0-403f-aa7b-b4910c92e108 tempest-VolumesListAdminTestJSON-107566669 None] Created volume successfully.
Apr 13 17:11:37 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7" released by "delete_volume" :: held 0.977s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Created reservations ['6c9d5f8a-cf2a-44b8-a700-5189e7229eb1', '98753a27-0fbb-4aff-bea8-36e4945c75de', 'a4f7443f-8326-403e-b77b-50703058348c', 'dbfe443e-a69a-443f-a549-c017733325f2'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:37 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:37 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:37 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64b11470-ab51-4c68-b104-71c2e9b481b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[28202fe1-c177-4ecf-a9b7-728ef09b4018]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:37 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4
Apr 13 17:11:37 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Flow 'volume_create_manager' (52570b83-93e0-4a46-92b8-fb05f609e211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf80670-eefe-435f-b9c2-1ae0b447f2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf80670-eefe-435f-b9c2-1ae0b447f2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1221590445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdf7a2e-35e2-4c19-a607-58693ed636a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bba854e9d4b420cad162356afe2a0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:37Z,use_quota=True,user_id='7ef185a2fabc4891a047e314b43d7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fa0ae7-0f26-4f12-be76-ddb25dcf4a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4fa0ae7-0f26-4f12-be76-ddb25dcf4a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946dce1e-fb2a-42e2-8a15-4527cf6b5d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946dce1e-fb2a-42e2-8a15-4527cf6b5d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdf7a2e-35e2-4c19-a607-58693ed636a4', 'volume_name': 'volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d079d1-3a1a-4472-aafb-abd50fa065f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2d079d1-3a1a-4472-aafb-abd50fa065f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e59026a-6742-42ac-8b25-76003a3df359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Volume bcdf7a2e-35e2-4c19-a607-58693ed636a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4', 'volume_size': 1}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1221590445',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdf7a2e-35e2-4c19-a607-58693ed636a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bba854e9d4b420cad162356afe2a0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:37Z,use_quota=True,user_id='7ef185a2fabc4891a047e314b43d7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Creating volume bcdf7a2e-35e2-4c19-a607-58693ed636a4 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:37 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:37 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4 1073741824
Apr 13 17:11:37 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:37 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Deleted volume successfully.
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-dd415ac9-1519-4d2b-89ab-45f180eddde1 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-72cbf55f-87a4-44ea-ac17-73cbcbbc0bb7-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:37 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:37 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6
Apr 13 17:11:37 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:37 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4 1073741824" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:38 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4
Apr 13 17:11:38 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "cinder-8718d4b0-ce40-4dde-a588-451ff19f131e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-8718d4b0-ce40-4dde-a588-451ff19f131e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "cinder-quobyte-8718d4b0-ce40-4dde-a588-451ff19f131e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-8718d4b0-ce40-4dde-a588-451ff19f131e" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:38 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61f0a2d-d378-425d-bdd0-9287647c134a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:38 devstack sudo[89459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6
Apr 13 17:11:38 devstack sudo[89459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:38 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e
Apr 13 17:11:38 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:38 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e59026a-6742-42ac-8b25-76003a3df359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f3d2f4-279c-4bfe-8979-f668cc983e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Volume volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4 (bcdf7a2e-35e2-4c19-a607-58693ed636a4): created successfully
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f3d2f4-279c-4bfe-8979-f668cc983e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Flow 'volume_create_manager' (52570b83-93e0-4a46-92b8-fb05f609e211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0173591c-7a68-40e4-a44a-6eda69ce9495 tempest-VolumesListAdminTestJSON-107566669 None] Created volume successfully.
Apr 13 17:11:38 devstack sudo[89459]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4.ca7c1575-b233-4a8a-9a2b-bc7f111195a6" returned: 0 in 0.403s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-ca7c1575-b233-4a8a-9a2b-bc7f111195a6" released by "_delete_snapshot" :: held 1.998s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-64b11470-ab51-4c68-b104-71c2e9b481b4" released by "delete_snapshot" :: held 2.013s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Created reservations ['f0c44eca-c98f-4f6e-bc14-4858bdb87313', 'c4703a1f-3bfd-447e-8104-7f2b2735cc86', '40e784dc-0543-4e4f-80a5-0d33ffd00849', '76951774-d51c-4ca5-9016-64384818d2f9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Delete snapshot completed successfully.
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6a4a4a46-ea88-4bd1-ba47-ce15fb71ec48 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-ca7c1575-b233-4a8a-9a2b-bc7f111195a6-delete_snapshot" released by "delete_snapshot" :: held 2.108s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:38 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:38 devstack sudo[89468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e
Apr 13 17:11:38 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:39 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8718d4b0-ce40-4dde-a588-451ff19f131e" returned: 0 in 0.392s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-quobyte-8718d4b0-ce40-4dde-a588-451ff19f131e" released by "delete_volume" :: held 0.942s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Created reservations ['5e11e327-745e-4781-b6b2-9851bad7ec80', '30c85041-eaa4-44c8-b9e6-67f2b8c0d2a1', 'cc7df679-728f-4dfb-b4be-3766fb2a9275', '06118c25-d5bf-47ed-acde-70405e540320'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:39 devstack sudo[89472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:39 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:39 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.480s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Deleted volume successfully.
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3923bbc6-957b-404d-9977-a317ac6ff556 tempest-CinderUnicodeTest-1268204903 None] Lock "cinder-8718d4b0-ce40-4dde-a588-451ff19f131e-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-64b11470-ab51-4c68-b104-71c2e9b481b4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-64b11470-ab51-4c68-b104-71c2e9b481b4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Flow 'volume_create_manager' (2ba75419-77c4-4a00-b316-4871a2d678dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09db4695-015d-44c9-a04f-16543c047c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09db4695-015d-44c9-a04f-16543c047c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-896731382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc19822e-356e-4c12-83fd-e0e22882f715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bba854e9d4b420cad162356afe2a0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:40Z,use_quota=True,user_id='7ef185a2fabc4891a047e314b43d7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e740f8bd-281c-4637-adeb-b568c2b484b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e740f8bd-281c-4637-adeb-b568c2b484b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654f8c5c-a10a-432f-a29b-4ab5f16e11b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654f8c5c-a10a-432f-a29b-4ab5f16e11b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc19822e-356e-4c12-83fd-e0e22882f715', 'volume_name': 'volume-fc19822e-356e-4c12-83fd-e0e22882f715', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe78d48f-e73c-4ce4-9ae4-d78e4b736c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe78d48f-e73c-4ce4-9ae4-d78e4b736c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a7d41d-1fd8-4c39-b9fb-333db473d19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:39 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Volume fc19822e-356e-4c12-83fd-e0e22882f715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc19822e-356e-4c12-83fd-e0e22882f715', 'volume_size': 1}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-896731382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc19822e-356e-4c12-83fd-e0e22882f715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bba854e9d4b420cad162356afe2a0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:40Z,use_quota=True,user_id='7ef185a2fabc4891a047e314b43d7596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Creating volume fc19822e-356e-4c12-83fd-e0e22882f715 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:39 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:39 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715 1073741824
Apr 13 17:11:39 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-quobyte-64b11470-ab51-4c68-b104-71c2e9b481b4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-64b11470-ab51-4c68-b104-71c2e9b481b4" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[904f4a4d-96cb-466a-a53a-05b440f21342]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:40 devstack sudo[89477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4
Apr 13 17:11:40 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:40 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715 1073741824" returned: 0 in 0.572s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:40 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715
Apr 13 17:11:40 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:40 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:40 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4
Apr 13 17:11:40 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:40 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a7d41d-1fd8-4c39-b9fb-333db473d19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc19822e-356e-4c12-83fd-e0e22882f715', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94905bfb-fc5f-4efb-a3f2-6c961eb2de50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:40 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Volume volume-fc19822e-356e-4c12-83fd-e0e22882f715 (fc19822e-356e-4c12-83fd-e0e22882f715): created successfully
Apr 13 17:11:40 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94905bfb-fc5f-4efb-a3f2-6c961eb2de50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Flow 'volume_create_manager' (2ba75419-77c4-4a00-b316-4871a2d678dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-64b11470-ab51-4c68-b104-71c2e9b481b4" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-64b11470-ab51-4c68-b104-71c2e9b481b4" released by "delete_volume" :: held 1.034s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ec0d0486-1f8c-41b1-8d9e-c04e91ce29d5 tempest-VolumesListAdminTestJSON-107566669 None] Created volume successfully.
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Created reservations ['afae9801-ac95-447d-8c9e-9846307563ff', '41429cc5-69d6-4811-9890-f4d4553b8603', '2f25c953-cdc1-44d8-a5b3-d4732edc9b5c', 'a218dece-d65d-4abd-81e9-0a5026954625'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:41 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:41 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:41 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.395s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Deleted volume successfully.
Apr 13 17:11:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d1ff614d-f5df-4091-ba4b-06f7c2345844 tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-64b11470-ab51-4c68-b104-71c2e9b481b4-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-78d9cae2-fc15-4fc8-8599-f9f8657e453d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-78d9cae2-fc15-4fc8-8599-f9f8657e453d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "cinder-quobyte-78d9cae2-fc15-4fc8-8599-f9f8657e453d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-78d9cae2-fc15-4fc8-8599-f9f8657e453d" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd47b74-d1f2-4c44-8271-a5c176109ab7]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:42 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d
Apr 13 17:11:42 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Flow 'volume_create_manager' (87ff1be0-75c0-4624-98f4-c354d5d860ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c76db5e-59c0-4e68-9f44-c9b865fdc71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c76db5e-59c0-4e68-9f44-c9b865fdc71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4947c763-8cd9-4d09-9f16-4dbc50755e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5039a3b37cb44641aef79dd85ebc434a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:42Z,use_quota=True,user_id='5dc78460501a4d88a9e644e9a008560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac239fe-5345-43b3-975c-3e82cdd599a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac239fe-5345-43b3-975c-3e82cdd599a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad101304-84a0-4887-ae6a-5d0347eb6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad101304-84a0-4887-ae6a-5d0347eb6269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4947c763-8cd9-4d09-9f16-4dbc50755e98', 'volume_name': 'volume-4947c763-8cd9-4d09-9f16-4dbc50755e98', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76136cda-1cca-4299-9192-3cf91d614b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76136cda-1cca-4299-9192-3cf91d614b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b179a6ec-e125-4ce9-8272-3673fd0f5d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Volume 4947c763-8cd9-4d09-9f16-4dbc50755e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4947c763-8cd9-4d09-9f16-4dbc50755e98', 'volume_size': 1}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4947c763-8cd9-4d09-9f16-4dbc50755e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5039a3b37cb44641aef79dd85ebc434a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:42Z,use_quota=True,user_id='5dc78460501a4d88a9e644e9a008560d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Creating volume 4947c763-8cd9-4d09-9f16-4dbc50755e98 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:42 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:42 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98 1073741824
Apr 13 17:11:42 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:42 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:42 devstack sudo[89501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d
Apr 13 17:11:42 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:42 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98 1073741824" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:42 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98
Apr 13 17:11:42 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:43 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-78d9cae2-fc15-4fc8-8599-f9f8657e453d" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-quobyte-78d9cae2-fc15-4fc8-8599-f9f8657e453d" released by "delete_volume" :: held 0.978s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Created reservations ['10aada6b-e4e5-45c4-a121-6d0b9cf50569', '0eb813a8-8c39-4c2a-b9bb-7c716d8def83', '0829976a-8dca-4ff1-8cbf-437ff8d05fc7', '143a79d0-2dfa-4323-9632-cd60e22d2aa0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:43 devstack sudo[89509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:43 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:43 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b179a6ec-e125-4ce9-8272-3673fd0f5d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4947c763-8cd9-4d09-9f16-4dbc50755e98', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a070753c-3043-4f7c-a605-6371020122d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:43 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Volume volume-4947c763-8cd9-4d09-9f16-4dbc50755e98 (4947c763-8cd9-4d09-9f16-4dbc50755e98): created successfully
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a070753c-3043-4f7c-a605-6371020122d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Flow 'volume_create_manager' (87ff1be0-75c0-4624-98f4-c354d5d860ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:43 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8b3824d7-d240-49ae-bcec-27e38b95695e tempest-VolumesListAdminTestJSON-429381540 None] Created volume successfully.
Apr 13 17:11:43 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:43 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Deleted volume successfully.
Apr 13 17:11:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-4b33e3ce-5010-4170-b581-452da96b2aae tempest-SnapshotDependencyTests-862241137 None] Lock "cinder-78d9cae2-fc15-4fc8-8599-f9f8657e453d-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Acquiring lock "cinder-4947c763-8cd9-4d09-9f16-4dbc50755e98-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Lock "cinder-4947c763-8cd9-4d09-9f16-4dbc50755e98-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Acquiring lock "cinder-quobyte-4947c763-8cd9-4d09-9f16-4dbc50755e98" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Lock "cinder-quobyte-4947c763-8cd9-4d09-9f16-4dbc50755e98" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bef6dc1-8329-47a2-b019-2c075edb6e4d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:44 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98
Apr 13 17:11:44 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "cinder-fc19822e-356e-4c12-83fd-e0e22882f715-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-fc19822e-356e-4c12-83fd-e0e22882f715-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "cinder-quobyte-fc19822e-356e-4c12-83fd-e0e22882f715" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-quobyte-fc19822e-356e-4c12-83fd-e0e22882f715" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[306460f6-17a8-4869-b1b5-2d87b69ccc06]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:45 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715
Apr 13 17:11:45 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:45 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98" returned: 0 in 0.529s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:45 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98
Apr 13 17:11:45 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:45 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715" returned: 0 in 0.551s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:45 devstack sudo[89526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715
Apr 13 17:11:45 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:45 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4947c763-8cd9-4d09-9f16-4dbc50755e98" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Lock "cinder-quobyte-4947c763-8cd9-4d09-9f16-4dbc50755e98" released by "delete_volume" :: held 1.027s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Created reservations ['0bf66f61-2ad0-47a4-89b4-6291a3569b10', '3310f957-2af8-4f00-bdb5-74e110035114', '9599887d-e6d1-43c2-ab69-d5365869bc12', '53011e0e-b61f-4006-bf3a-2fd10bcbbd25'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:45 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:45 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:45 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-fc19822e-356e-4c12-83fd-e0e22882f715" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-quobyte-fc19822e-356e-4c12-83fd-e0e22882f715" released by "delete_volume" :: held 1.027s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Created reservations ['1417cfa1-cb6d-410c-8bc3-65da3b9c701d', 'b1451854-52d8-4827-8770-93c7cf134e77', 'c8355f42-6175-40e0-8800-599f112c7676', '52c6aada-1a3a-49c3-b4b0-bf4117a2775e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:46 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:46 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:46 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.521s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Deleted volume successfully.
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7b9b7858-58bf-40c1-b580-4b6664d964d0 tempest-VolumesListAdminTestJSON-429381540 None] Lock "cinder-4947c763-8cd9-4d09-9f16-4dbc50755e98-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:46 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Deleted volume successfully.
Apr 13 17:11:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cccc2faa-6bba-41fe-b8a2-24aba7330cef tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-fc19822e-356e-4c12-83fd-e0e22882f715-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "cinder-bcdf7a2e-35e2-4c19-a607-58693ed636a4-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-bcdf7a2e-35e2-4c19-a607-58693ed636a4-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "cinder-quobyte-bcdf7a2e-35e2-4c19-a607-58693ed636a4" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-quobyte-bcdf7a2e-35e2-4c19-a607-58693ed636a4" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[227fff68-4bd2-43e1-aecd-5225a5a6890b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:47 devstack sudo[89537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4
Apr 13 17:11:47 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:47 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:47 devstack sudo[89543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4
Apr 13 17:11:47 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:48 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-bcdf7a2e-35e2-4c19-a607-58693ed636a4" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-quobyte-bcdf7a2e-35e2-4c19-a607-58693ed636a4" released by "delete_volume" :: held 0.942s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Created reservations ['ff6de486-64ae-4a74-8904-5c653cdcfa28', '8194e35b-a7aa-4f5c-a052-4fa4a32906c0', 'd92d8044-57e6-42c6-a524-a8541f1c2971', '2ddb5a30-47c9-49e4-bc4d-cd2b016f74bc'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:48 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:48 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "cinder-31b119b5-fe07-4c36-9fc1-5c3000bcce62-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-31b119b5-fe07-4c36-9fc1-5c3000bcce62-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "cinder-quobyte-31b119b5-fe07-4c36-9fc1-5c3000bcce62" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-quobyte-31b119b5-fe07-4c36-9fc1-5c3000bcce62" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6090d9ef-2215-4a1e-a427-0ede55183a41]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:48 devstack sudo[89548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62
Apr 13 17:11:48 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:48 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.462s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Deleted volume successfully.
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-597b76e7-53d9-4f22-8ede-2563321dc09e tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-bcdf7a2e-35e2-4c19-a607-58693ed636a4-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:48 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62" returned: 0 in 0.575s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:48 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62
Apr 13 17:11:49 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:49 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-31b119b5-fe07-4c36-9fc1-5c3000bcce62" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-quobyte-31b119b5-fe07-4c36-9fc1-5c3000bcce62" released by "delete_volume" :: held 1.106s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Created reservations ['669e2d50-51fc-46a6-8f59-f9170ff54212', '9326649e-3647-4d6c-83cf-08d37902c1a7', 'bb614306-29de-4089-8f83-b127c6d81dca', '2c08cda5-1cb0-4178-83b3-daac3c710e9f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:49 devstack sudo[89561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:11:49 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:50 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:50 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:11:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Deleted volume successfully.
Apr 13 17:11:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-02f6444c-42bd-4250-b6f3-ce0afe0bc52b tempest-VolumesListAdminTestJSON-107566669 None] Lock "cinder-31b119b5-fe07-4c36-9fc1-5c3000bcce62-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Flow 'volume_create_manager' (5f355f12-39f0-4ed4-9d7e-3274a9f8cc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4234825a-d20f-4630-b8d6-2b9edc1cde8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4234825a-d20f-4630-b8d6-2b9edc1cde8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-609715168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861b5d84-931d-482d-8d5b-7c500acd344d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8567c1d80bdd42f9b9a87de908c56ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:55Z,use_quota=True,user_id='2c2e9d3606e64075838c0df102ca7e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7670a98-1d43-4700-b908-d0df35925a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7670a98-1d43-4700-b908-d0df35925a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8becee81-69ec-4669-8b7b-ed6676432617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8becee81-69ec-4669-8b7b-ed6676432617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861b5d84-931d-482d-8d5b-7c500acd344d', 'volume_name': 'volume-861b5d84-931d-482d-8d5b-7c500acd344d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f756c46d-8942-4919-8775-d32d6a9b2dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f756c46d-8942-4919-8775-d32d6a9b2dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c2ed00-819a-409f-a15a-6e85edeec35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Volume 861b5d84-931d-482d-8d5b-7c500acd344d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861b5d84-931d-482d-8d5b-7c500acd344d', 'volume_size': 1}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-609715168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861b5d84-931d-482d-8d5b-7c500acd344d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8567c1d80bdd42f9b9a87de908c56ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:11:55Z,use_quota=True,user_id='2c2e9d3606e64075838c0df102ca7e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Creating volume 861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:11:55 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:55 devstack sudo[89570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d 1073741824
Apr 13 17:11:55 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:55 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d 1073741824" returned: 0 in 0.450s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:55 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d
Apr 13 17:11:55 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:56 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d" returned: 0 in 0.397s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c2ed00-819a-409f-a15a-6e85edeec35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861b5d84-931d-482d-8d5b-7c500acd344d', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60418193-8be7-4092-9bac-cb13eea05954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:11:56 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Volume volume-861b5d84-931d-482d-8d5b-7c500acd344d (861b5d84-931d-482d-8d5b-7c500acd344d): created successfully
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60418193-8be7-4092-9bac-cb13eea05954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Flow 'volume_create_manager' (5f355f12-39f0-4ed4-9d7e-3274a9f8cc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:11:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cb3c7a3b-d9c9-4083-b78c-6766fe4f83df tempest-VolumesDeleteCascade-1126992119 None] Created volume successfully.
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Creating offline snapshot 6a8a1a26-fd08-4772-9ffe-3c162a5e9deb of volume 861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef1fa8a-6b54-41b4-a1ae-92065b303352]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:56 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d
Apr 13 17:11:56 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:56 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:56 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb 1G
Apr 13 17:11:56 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:57 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb 1G" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:57 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb
Apr 13 17:11:57 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:57 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" returned: 0 in 0.396s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:57 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb is being set with open permissions: ugo+rw
Apr 13 17:11:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:57 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb
Apr 13 17:11:57 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:58 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" returned: 0 in 0.382s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:58 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.info
Apr 13 17:11:58 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:58 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.info" returned: 0 in 0.399s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:58 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.info is being set with open permissions: ugo+rw
Apr 13 17:11:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:58 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.info
Apr 13 17:11:58 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:11:58 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 13 17:11:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.info" returned: 0 in 0.376s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:11:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.483s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:11:58 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=158,cinder:UPDATE=235,cinder:DELETE=17,cinder:INSERT=46 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:11:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-19c48388-ac63-4833-8488-df1bbb9360ce tempest-VolumesDeleteCascade-1126992119 None] Create snapshot completed successfully
Apr 13 17:11:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:11:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:11:59 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Creating offline snapshot ca5459d0-b202-46f2-acd2-64704bc45ada of volume 861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:11:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66cf54a-805c-4d24-b599-732df9f32592]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:11:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:11:59 devstack sudo[89637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb
Apr 13 17:11:59 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:00 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861b5d84-931d-482d-8d5b-7c500acd344d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:12:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:00 devstack sudo[89642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada 1G
Apr 13 17:12:00 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:00 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada 1G" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:00 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada
Apr 13 17:12:00 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:01 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada" returned: 0 in 0.437s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:01 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada is being set with open permissions: ugo+rw
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:01 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada
Apr 13 17:12:01 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:01 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada" returned: 0 in 0.391s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.778s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-54e72477-dda9-4d95-a87d-8f83a2c75e42 tempest-VolumesDeleteCascade-1126992119 None] Create snapshot completed successfully
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-861b5d84-931d-482d-8d5b-7c500acd344d-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-861b5d84-931d-482d-8d5b-7c500acd344d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Performing cascade delete. {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-6a8a1a26-fd08-4772-9ffe-3c162a5e9deb-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-6a8a1a26-fd08-4772-9ffe-3c162a5e9deb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Deleting offline snapshot 6a8a1a26-fd08-4772-9ffe-3c162a5e9deb of volume 861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] snapshot_file for this snap is: volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0040b18d-305d-4138-af65-b7136e83a802]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:01 devstack sudo[89656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb
Apr 13 17:12:01 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:02 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861b5d84-931d-482d-8d5b-7c500acd344d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:12:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2423b0eb-c404-46ed-b45e-17159868e20b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:02 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d
Apr 13 17:12:02 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:02 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb171e99-1750-4bf5-96dc-1054647bf081]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:02 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada
Apr 13 17:12:02 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:03 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861b5d84-931d-482d-8d5b-7c500acd344d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5423126c-287c-48a7-a0bc-c40dc8ebc522]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:03 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb
Apr 13 17:12:03 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:03 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861b5d84-931d-482d-8d5b-7c500acd344d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb8d27-2ee3-4fcb-9444-1cbcb781f876]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:03 devstack sudo[89676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d
Apr 13 17:12:03 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:04 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:04 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb
Apr 13 17:12:04 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:04 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" returned: 0 in 0.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:04 devstack sudo[89686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb
Apr 13 17:12:04 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:04 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" returned: 0 in 0.388s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada -F qcow2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:04 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada -F qcow2
Apr 13 17:12:04 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:05 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861b5d84-931d-482d-8d5b-7c500acd344d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada -F qcow2" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-6a8a1a26-fd08-4772-9ffe-3c162a5e9deb" released by "_delete_snapshot" :: held 3.541s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" released by "delete_snapshot" :: held 3.551s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Created reservations ['a122457b-2a5e-4a42-9606-934b40e1b12e', 'b2f1bf65-9c01-408d-b4d9-98207e2ea673', 'bbc50342-ae2b-49fd-8c1c-fdd75227915b', '7b3d3646-1d38-4d46-8845-c6347058901d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Delete snapshot completed successfully.
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-6a8a1a26-fd08-4772-9ffe-3c162a5e9deb-delete_snapshot" released by "delete_snapshot" :: held 3.638s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-ca5459d0-b202-46f2-acd2-64704bc45ada-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-ca5459d0-b202-46f2-acd2-64704bc45ada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-ca5459d0-b202-46f2-acd2-64704bc45ada" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-ca5459d0-b202-46f2-acd2-64704bc45ada" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Deleting offline snapshot ca5459d0-b202-46f2-acd2-64704bc45ada of volume 861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] snapshot_file for this snap is: volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b475ca9-ed5e-4522-8c8e-59ccc62652ea]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:05 devstack sudo[89694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada
Apr 13 17:12:05 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:05 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada" returned: 0 in 0.437s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861b5d84-931d-482d-8d5b-7c500acd344d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505f08e-1227-4855-ab80-4b93fef169c8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:06 devstack sudo[89699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d
Apr 13 17:12:06 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:06 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:06 devstack sudo[89704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada
Apr 13 17:12:06 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:06 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:06 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada
Apr 13 17:12:06 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:07 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d.ca5459d0-b202-46f2-acd2-64704bc45ada" returned: 0 in 0.389s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-ca5459d0-b202-46f2-acd2-64704bc45ada" released by "_delete_snapshot" :: held 1.753s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" released by "delete_snapshot" :: held 1.768s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Created reservations ['b3bcffcd-7321-4b3e-9ac8-1e5cf96a0eb6', 'df49261f-0650-482e-81af-9d5ae4af813a', '00f62407-dbff-4323-9b16-a95a2ffd2676', 'f847bd21-a41b-4ee7-8d45-aeacc62f40b5'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Delete snapshot completed successfully.
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-ca5459d0-b202-46f2-acd2-64704bc45ada-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Snapshots deleted, issuing volume delete {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[00caf828-6983-459f-b459-25eacfe9989b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:07 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d
Apr 13 17:12:07 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:07 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:07 devstack sudo[89717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d
Apr 13 17:12:07 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:08 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-861b5d84-931d-482d-8d5b-7c500acd344d" returned: 0 in 0.400s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-861b5d84-931d-482d-8d5b-7c500acd344d" released by "delete_volume" :: held 0.869s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Created reservations ['81d2f7f3-be4e-4c31-8f5f-25e2835f54a3', '5cd6207a-5563-4a69-8948-b8a83011ec1a', '1d2d4077-3f9d-4e00-b92f-8cd7535fed24', '75e0561a-98c1-45f9-bace-ca76b94a10cb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:08 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:12:08 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:08 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.397s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:12:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Deleted volume successfully.
Apr 13 17:12:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8af9b141-d81d-426c-9bf0-f1f0390343c8 tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-861b5d84-931d-482d-8d5b-7c500acd344d-delete_volume" released by "delete_volume" :: held 6.905s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Flow 'volume_create_manager' (da9e17eb-ab0f-4b98-ba9b-77e1be311ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bb200f-fe49-45b8-8e41-f5064c8f2c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bb200f-fe49-45b8-8e41-f5064c8f2c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726975209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b667e4bc-ff7c-4fb8-915b-1a56ffc21956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8567c1d80bdd42f9b9a87de908c56ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:09Z,use_quota=True,user_id='2c2e9d3606e64075838c0df102ca7e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19fc1520-06f2-4d0b-9a52-d7b3de5dc7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19fc1520-06f2-4d0b-9a52-d7b3de5dc7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc33727b-240b-4a89-96c2-fa238fd6c5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc33727b-240b-4a89-96c2-fa238fd6c5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b667e4bc-ff7c-4fb8-915b-1a56ffc21956', 'volume_name': 'volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998265e2-e21a-486e-b201-d89545a9ef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998265e2-e21a-486e-b201-d89545a9ef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd070685-3f72-42f3-86a0-05b9c7751796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Volume b667e4bc-ff7c-4fb8-915b-1a56ffc21956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956', 'volume_size': 1}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1726975209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b667e4bc-ff7c-4fb8-915b-1a56ffc21956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8567c1d80bdd42f9b9a87de908c56ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:09Z,use_quota=True,user_id='2c2e9d3606e64075838c0df102ca7e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Creating volume b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:12:09 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:12:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:09 devstack sudo[89724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 1073741824
Apr 13 17:12:09 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:10 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 1073741824" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:10 devstack sudo[89729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956
Apr 13 17:12:10 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:10 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" returned: 0 in 0.385s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd070685-3f72-42f3-86a0-05b9c7751796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001a32cd-a0e8-41ea-aac0-5401e93b3065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Volume volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 (b667e4bc-ff7c-4fb8-915b-1a56ffc21956): created successfully
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001a32cd-a0e8-41ea-aac0-5401e93b3065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Flow 'volume_create_manager' (da9e17eb-ab0f-4b98-ba9b-77e1be311ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9febdc71-7c50-425d-b5aa-378fb321424d tempest-VolumesDeleteCascade-1126992119 None] Created volume successfully.
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Creating offline snapshot 3179482c-fec9-4c23-a973-e09f63b6cbf1 of volume b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0b758f-8594-4d65-ba6f-58cd38a65b4e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:10 devstack sudo[89732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956
Apr 13 17:12:10 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:11 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:11 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 1G
Apr 13 17:12:11 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:11 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 1G" returned: 0 in 0.441s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:11 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1
Apr 13 17:12:11 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:11 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:11 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 is being set with open permissions: ugo+rw
Apr 13 17:12:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:11 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1
Apr 13 17:12:11 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:12 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1" returned: 0 in 0.386s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:12 devstack sudo[89750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.info
Apr 13 17:12:12 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:12 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.info" returned: 0 in 0.390s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:12 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.info is being set with open permissions: ugo+rw
Apr 13 17:12:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:12 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.info
Apr 13 17:12:12 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:13 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.info" returned: 0 in 0.391s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-4c55ebbb-5b5e-4879-9c0a-8ff766860234 tempest-VolumesDeleteCascade-1126992119 None] Create snapshot completed successfully
Apr 13 17:12:13 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Flow 'volume_create_manager' (0333ef17-df6c-4055-bf6d-96dd1dc9ccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b497e6b-2b71-4dc2-a772-d579e5ce6d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=140,cinder:INSERT=55,cinder:UPDATE=166,cinder:DELETE=16 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b497e6b-2b71-4dc2-a772-d579e5ce6d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1355438802',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26535cc5-7e35-465a-aee7-17a9d475f356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8567c1d80bdd42f9b9a87de908c56ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3179482c-fec9-4c23-a973-e09f63b6cbf1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:14Z,use_quota=True,user_id='2c2e9d3606e64075838c0df102ca7e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2834a8b-627a-4344-a115-12d343ada974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2834a8b-627a-4344-a115-12d343ada974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b70f7b-28f2-4506-954b-4adc58276e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b70f7b-28f2-4506-954b-4adc58276e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26535cc5-7e35-465a-aee7-17a9d475f356', 'volume_name': 'volume-26535cc5-7e35-465a-aee7-17a9d475f356', 'volume_size': 1, 'snapshot_id': '3179482c-fec9-4c23-a973-e09f63b6cbf1'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8ea88f-d756-4111-a8f1-59de094f8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b8ea88f-d756-4111-a8f1-59de094f8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa75330-31c9-4bb4-9952-40b25ef17382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Volume 26535cc5-7e35-465a-aee7-17a9d475f356: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26535cc5-7e35-465a-aee7-17a9d475f356', 'volume_size': 1, 'snapshot_id': '3179482c-fec9-4c23-a973-e09f63b6cbf1'}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-3179482c-fec9-4c23-a973-e09f63b6cbf1-26535cc5-7e35-465a-aee7-17a9d475f356" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-3179482c-fec9-4c23-a973-e09f63b6cbf1-26535cc5-7e35-465a-aee7-17a9d475f356" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Creating volume 26535cc5-7e35-465a-aee7-17a9d475f356 from snapshot 3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-26535cc5-7e35-465a-aee7-17a9d475f356" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-26535cc5-7e35-465a-aee7-17a9d475f356" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] snapshot: 3179482c-fec9-4c23-a973-e09f63b6cbf1, volume: 26535cc5-7e35-465a-aee7-17a9d475f356,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[877909bf-93f6-4348-8fc0-90357df458ba]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:14 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1
Apr 13 17:12:14 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:14 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a73a06-9a99-4079-8e61-51a663aa6e4e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:14 devstack sudo[89761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956
Apr 13 17:12:14 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:15 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:15 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:12:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:15 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356
Apr 13 17:12:15 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:16 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356" returned: 0 in 1.821s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6468acda-8829-4a4c-8b92-4f73d4592d29]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:16 devstack sudo[89778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956
Apr 13 17:12:16 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:17 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:12:17 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Converted 1024.00 MB image at 561.98 MB/s
Apr 13 17:12:17 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356 is being set with open permissions: ugo+rw
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:17 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356
Apr 13 17:12:17 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:17 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-26535cc5-7e35-465a-aee7-17a9d475f356" released by "_copy_volume_from_snapshot" :: held 3.763s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-3179482c-fec9-4c23-a973-e09f63b6cbf1-26535cc5-7e35-465a-aee7-17a9d475f356" released by "_create_volume_from_snapshot" :: held 3.779s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.792s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa75330-31c9-4bb4-9952-40b25ef17382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26535cc5-7e35-465a-aee7-17a9d475f356', 'volume_size': 1, 'snapshot_id': '3179482c-fec9-4c23-a973-e09f63b6cbf1'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4117f7-0ce6-40a7-905c-f8c197a1fc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:17 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Volume volume-26535cc5-7e35-465a-aee7-17a9d475f356 (26535cc5-7e35-465a-aee7-17a9d475f356): created successfully
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4117f7-0ce6-40a7-905c-f8c197a1fc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:17 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Flow 'volume_create_manager' (0333ef17-df6c-4055-bf6d-96dd1dc9ccb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-59a2cd2b-9b4e-498d-b813-c04c8868325c tempest-VolumesDeleteCascade-1126992119 None] Created volume successfully.
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-b667e4bc-ff7c-4fb8-915b-1a56ffc21956-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-b667e4bc-ff7c-4fb8-915b-1a56ffc21956-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Performing cascade delete. {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-3179482c-fec9-4c23-a973-e09f63b6cbf1-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-3179482c-fec9-4c23-a973-e09f63b6cbf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-3179482c-fec9-4c23-a973-e09f63b6cbf1" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-3179482c-fec9-4c23-a973-e09f63b6cbf1" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Deleting offline snapshot 3179482c-fec9-4c23-a973-e09f63b6cbf1 of volume b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] snapshot_file for this snap is: volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5bcf29-3e5e-4aa8-a979-1601b8a62d1c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:18 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1
Apr 13 17:12:18 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:18 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b835ed-c37d-4521-8283-e3bfd8bfd2c7]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:18 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956
Apr 13 17:12:18 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:19 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:19 devstack sudo[89797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1
Apr 13 17:12:19 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:19 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:19 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1
Apr 13 17:12:19 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:20 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956.3179482c-fec9-4c23-a973-e09f63b6cbf1" returned: 0 in 0.393s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-3179482c-fec9-4c23-a973-e09f63b6cbf1" released by "_delete_snapshot" :: held 1.820s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" released by "delete_snapshot" :: held 1.834s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Created reservations ['5272f9b3-eb32-484a-8dc6-ff1210e3f478', '8079733b-66da-4a20-9448-c57b1cfc30b4', '11ae944c-d0f6-4648-96a9-f84dffbf6d3d', '3bbff82e-886a-4924-9ce4-321d00a8fae3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Delete snapshot completed successfully.
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-3179482c-fec9-4c23-a973-e09f63b6cbf1-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Snapshots deleted, issuing volume delete {{(pid=82641) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba4d10-b51b-44c3-b4ce-44c460ea312e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:20 devstack sudo[89805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956
Apr 13 17:12:20 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:20 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:20 devstack sudo[89810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956
Apr 13 17:12:20 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:21 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-b667e4bc-ff7c-4fb8-915b-1a56ffc21956" released by "delete_volume" :: held 0.887s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Created reservations ['9d159b2e-bea2-476f-8cfd-a8a2d7d51d24', 'ab8e6a11-23f2-4524-aff7-e1ac8fc0d4bb', 'e809e268-59f2-42df-afdd-70d553e6ff2f', 'ee579093-c51c-41b9-baf1-b67daacb74b4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:21 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:12:21 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-26535cc5-7e35-465a-aee7-17a9d475f356-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-26535cc5-7e35-465a-aee7-17a9d475f356-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "cinder-quobyte-26535cc5-7e35-465a-aee7-17a9d475f356" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-26535cc5-7e35-465a-aee7-17a9d475f356" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa5f2d-e7a5-4209-a7d8-dfea956ec591]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:21 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.459s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:12:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Deleted volume successfully.
Apr 13 17:12:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a4268a15-999a-4d4d-8439-59c72cdf43cd tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-b667e4bc-ff7c-4fb8-915b-1a56ffc21956-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:21 devstack sudo[89817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356
Apr 13 17:12:21 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:22 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:22 devstack sudo[89822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356
Apr 13 17:12:22 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:22 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-26535cc5-7e35-465a-aee7-17a9d475f356" returned: 0 in 0.406s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-quobyte-26535cc5-7e35-465a-aee7-17a9d475f356" released by "delete_volume" :: held 0.873s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Created reservations ['c5f10784-183b-449b-bc92-34cb1c487136', 'ae51adc8-8fad-4777-9b9d-fa6c6b41a7ef', 'd7d3887a-a4ef-42be-912f-aab95788357f', '091f0d9f-0323-44e1-b33f-cc05318501f6'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:22 devstack sudo[89825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:12:22 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:23 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.442s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:23 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:12:23 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Deleted volume successfully.
Apr 13 17:12:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2a632f2a-dcc3-44ad-a947-bdc792a0a0de tempest-VolumesDeleteCascade-1126992119 None] Lock "cinder-26535cc5-7e35-465a-aee7-17a9d475f356-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Flow 'volume_create_manager' (58accc16-b07c-4c34-b066-5624d867cdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908bee41-f006-4e57-a2cc-09a84f9aa265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908bee41-f006-4e57-a2cc-09a84f9aa265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-993727039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0e25bd-c589-450a-a447-c48547ecfc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b749c372284472bb56b41701f5a787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:25Z,use_quota=True,user_id='b0ad28e752dc449fb53488bfe3e9a485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f8963c-98f0-4ba7-99bc-168db84fc756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f8963c-98f0-4ba7-99bc-168db84fc756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de657a84-3895-4b44-a2b5-81d5192645ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de657a84-3895-4b44-a2b5-81d5192645ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c0e25bd-c589-450a-a447-c48547ecfc67', 'volume_name': 'volume-5c0e25bd-c589-450a-a447-c48547ecfc67', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbf09fc-3609-43c2-a77f-c9f2c946354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbf09fc-3609-43c2-a77f-c9f2c946354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fd1f0b-9eb6-4c95-b6ed-67a3e97e6d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:25 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Volume 5c0e25bd-c589-450a-a447-c48547ecfc67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c0e25bd-c589-450a-a447-c48547ecfc67', 'volume_size': 1}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-993727039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0e25bd-c589-450a-a447-c48547ecfc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b749c372284472bb56b41701f5a787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:25Z,use_quota=True,user_id='b0ad28e752dc449fb53488bfe3e9a485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Creating volume 5c0e25bd-c589-450a-a447-c48547ecfc67 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:12:25 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:25 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67 1073741824
Apr 13 17:12:25 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:25 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67 1073741824" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:25 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67
Apr 13 17:12:25 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:26 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67" returned: 0 in 0.389s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:12:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07fd1f0b-9eb6-4c95-b6ed-67a3e97e6d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0e25bd-c589-450a-a447-c48547ecfc67', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511b7256-c19e-497d-88e6-f8d2a8eb0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:26 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Volume volume-5c0e25bd-c589-450a-a447-c48547ecfc67 (5c0e25bd-c589-450a-a447-c48547ecfc67): created successfully
Apr 13 17:12:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (511b7256-c19e-497d-88e6-f8d2a8eb0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:26 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Flow 'volume_create_manager' (58accc16-b07c-4c34-b066-5624d867cdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d895ac64-b2e6-4544-93d4-9304fd3227f2 tempest-VolumesTransfersTest-1725259710 None] Created volume successfully.
Apr 13 17:12:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8f7b5da9-d616-44cc-a89c-0534c5d32a14 tempest-VolumesTransfersTest-306686099 None] Transfer volume completed successfully.
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Acquiring lock "cinder-5c0e25bd-c589-450a-a447-c48547ecfc67-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-5c0e25bd-c589-450a-a447-c48547ecfc67-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Acquiring lock "cinder-quobyte-5c0e25bd-c589-450a-a447-c48547ecfc67" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-quobyte-5c0e25bd-c589-450a-a447-c48547ecfc67" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[04808bde-e968-4392-8201-3502e2600174]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:27 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67
Apr 13 17:12:27 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:27 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67" returned: 0 in 0.450s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:27 devstack sudo[89842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67
Apr 13 17:12:27 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:28 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-5c0e25bd-c589-450a-a447-c48547ecfc67" returned: 0 in 0.384s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-quobyte-5c0e25bd-c589-450a-a447-c48547ecfc67" released by "delete_volume" :: held 0.854s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Created reservations ['9380f6ff-a8cb-4761-8083-fba0b5d86305', '6f02a2ef-d5fc-48b5-a367-cfa0b7043157', 'd3cda1a5-432a-403d-8f82-e7b91db83af1', '9f09ea55-9828-4d10-8a54-67438da00bc4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:28 devstack sudo[89845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:12:28 devstack sudo[89845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Flow 'volume_create_manager' (8c7c87a9-c3b4-4484-aa39-66da13e58a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b93860c-b84f-4b37-a0d2-bf13adb43e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:28 devstack sudo[89845]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b93860c-b84f-4b37-a0d2-bf13adb43e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-863698106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6517a76e-f2f9-4e3d-bc80-fcd53ce0f222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b749c372284472bb56b41701f5a787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:29Z,use_quota=True,user_id='b0ad28e752dc449fb53488bfe3e9a485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de19744-c80a-4f9c-bb8f-fd1cf7d7be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de19744-c80a-4f9c-bb8f-fd1cf7d7be67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1606e183-3446-42e2-9f73-f38c41a7dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1606e183-3446-42e2-9f73-f38c41a7dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6517a76e-f2f9-4e3d-bc80-fcd53ce0f222', 'volume_name': 'volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d0d7c2-1fad-4cd8-a2f7-eaf8302ec10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d0d7c2-1fad-4cd8-a2f7-eaf8302ec10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13178f47-5adf-4619-8c7c-447af44670c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Volume 6517a76e-f2f9-4e3d-bc80-fcd53ce0f222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222', 'volume_size': 1}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-863698106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6517a76e-f2f9-4e3d-bc80-fcd53ce0f222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5b749c372284472bb56b41701f5a787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:29Z,use_quota=True,user_id='b0ad28e752dc449fb53488bfe3e9a485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Creating volume 6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:12:28 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:12:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Deleted volume successfully.
Apr 13 17:12:28 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 1073741824
Apr 13 17:12:28 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bdc4b9dc-85c8-4ca8-b488-8a95f94d9f54 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-5c0e25bd-c589-450a-a447-c48547ecfc67-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:29 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 1073741824" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:29 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222
Apr 13 17:12:29 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:29 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222" returned: 0 in 0.406s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13178f47-5adf-4619-8c7c-447af44670c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b94bf72-f44a-41da-bc01-ee33a2922589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Volume volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 (6517a76e-f2f9-4e3d-bc80-fcd53ce0f222): created successfully
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b94bf72-f44a-41da-bc01-ee33a2922589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Flow 'volume_create_manager' (8c7c87a9-c3b4-4484-aa39-66da13e58a7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f2c2cd88-ca0d-4d8c-9a1e-26dc206e83d6 tempest-VolumesTransfersTest-1725259710 None] Created volume successfully.
Apr 13 17:12:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Acquiring lock "cinder-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Acquiring lock "cinder-quobyte-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-quobyte-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e5c8c6-9b3a-4a4d-ba9d-2d04b60c9043]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:31 devstack sudo[89857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222
Apr 13 17:12:31 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:31 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:31 devstack sudo[89862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222
Apr 13 17:12:31 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:31 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222" returned: 0 in 0.381s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-quobyte-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222" released by "delete_volume" :: held 0.862s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Created reservations ['598174fb-6c07-4c29-af8d-61e644b73f73', 'ab9dee62-f501-4a75-94f5-327a0b168bb0', '380c6467-a59a-4ff0-bd8c-3013258416ed', '413855ba-e8b6-489a-8b5d-ef98cfcfb382'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:31 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:12:31 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:32 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:32 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:12:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Deleted volume successfully.
Apr 13 17:12:32 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-332da8ae-4f42-42c8-8be9-a878d4d76dd9 tempest-VolumesTransfersTest-116278601 None] Lock "cinder-6517a76e-f2f9-4e3d-bc80-fcd53ce0f222-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Flow 'volume_create_manager' (16b01693-66e1-423f-a14e-00ab31c9a640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03a4fd6-312f-4ed2-8a80-05cfab8bef48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03a4fd6-312f-4ed2-8a80-05cfab8bef48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-913617233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24fc7f04-7ef3-40ce-859f-b3d148e1898f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1851996bde4a73b79f783e6fff4071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:36Z,use_quota=True,user_id='afd1c265d4104653beb10d956addfb45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ab7687-921c-4868-8eeb-581493b6185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ab7687-921c-4868-8eeb-581493b6185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ab237-8682-4689-a61b-5446e32bafd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4ab237-8682-4689-a61b-5446e32bafd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24fc7f04-7ef3-40ce-859f-b3d148e1898f', 'volume_name': 'volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7525ffdc-8278-4949-bfd5-52432d1ceefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7525ffdc-8278-4949-bfd5-52432d1ceefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f3a45-4557-449c-90ae-44235107f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Volume 24fc7f04-7ef3-40ce-859f-b3d148e1898f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f', 'volume_size': 1}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-913617233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24fc7f04-7ef3-40ce-859f-b3d148e1898f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1851996bde4a73b79f783e6fff4071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:36Z,use_quota=True,user_id='afd1c265d4104653beb10d956addfb45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Creating volume 24fc7f04-7ef3-40ce-859f-b3d148e1898f {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:12:36 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:36 devstack sudo[89868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f 1073741824
Apr 13 17:12:36 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:36 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f 1073741824" returned: 0 in 0.533s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:36 devstack sudo[89873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f
Apr 13 17:12:36 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:37 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:12:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02f3a45-4557-449c-90ae-44235107f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ce1ecf-791c-4831-9564-63e9897a72af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:37 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Volume volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f (24fc7f04-7ef3-40ce-859f-b3d148e1898f): created successfully
Apr 13 17:12:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ce1ecf-791c-4831-9564-63e9897a72af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:37 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Flow 'volume_create_manager' (16b01693-66e1-423f-a14e-00ab31c9a640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:37 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-dbc6e32a-501d-46b7-94bc-e006199a20c3 tempest-VolumesTransfersV355Test-786820260 None] Created volume successfully.
Apr 13 17:12:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e9f9b273-4ced-4ee8-b84e-7b3f9b733711 tempest-VolumesTransfersV355Test-182402454 None] Transfer volume completed successfully.
Apr 13 17:12:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Acquiring lock "cinder-24fc7f04-7ef3-40ce-859f-b3d148e1898f-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-24fc7f04-7ef3-40ce-859f-b3d148e1898f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Acquiring lock "cinder-quobyte-24fc7f04-7ef3-40ce-859f-b3d148e1898f" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:39 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-quobyte-24fc7f04-7ef3-40ce-859f-b3d148e1898f" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:39 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d661555-8ab9-4117-9b5e-ed206558ef81]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:39 devstack sudo[89877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f
Apr 13 17:12:39 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:40 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:40 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f
Apr 13 17:12:40 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:40 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-24fc7f04-7ef3-40ce-859f-b3d148e1898f" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-quobyte-24fc7f04-7ef3-40ce-859f-b3d148e1898f" released by "delete_volume" :: held 0.961s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Created reservations ['c67fca41-6a3f-4ccc-886d-5f53c14d2f26', '22e2985d-3fda-45f7-8592-cfe1806e5968', 'c4286345-6b4f-4e44-855c-10cc3797326a', 'ec092d9d-dce4-46a0-9ed3-a1ed577ad193'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:40 devstack sudo[89885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:12:40 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:40 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.394s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:40 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:12:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Deleted volume successfully.
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-9a73f9ec-222d-4a24-8bdb-77c78e5892fb tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-24fc7f04-7ef3-40ce-859f-b3d148e1898f-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Flow 'volume_create_manager' (2212050d-30c7-4569-a324-5d301c088307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e2ba8f-944f-4947-8720-f661e8409855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e2ba8f-944f-4947-8720-f661e8409855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2066869918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3486f827-de91-4a83-b0c0-faa27c5c5ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1851996bde4a73b79f783e6fff4071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:42Z,use_quota=True,user_id='afd1c265d4104653beb10d956addfb45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9773485-7caf-4823-8e1a-6fed6454ef22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9773485-7caf-4823-8e1a-6fed6454ef22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc2d370-90f4-47f1-8fbf-a3318842dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cc2d370-90f4-47f1-8fbf-a3318842dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3486f827-de91-4a83-b0c0-faa27c5c5ef5', 'volume_name': 'volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7261ce62-8097-480e-81e8-94a5013a7fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7261ce62-8097-480e-81e8-94a5013a7fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9add33cd-a7fc-452c-ae07-2a684253f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:41 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Volume 3486f827-de91-4a83-b0c0-faa27c5c5ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5', 'volume_size': 1}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2066869918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3486f827-de91-4a83-b0c0-faa27c5c5ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb1851996bde4a73b79f783e6fff4071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:42Z,use_quota=True,user_id='afd1c265d4104653beb10d956addfb45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Creating volume 3486f827-de91-4a83-b0c0-faa27c5c5ef5 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:12:41 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:12:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:42 devstack sudo[89888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5 1073741824
Apr 13 17:12:42 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:42 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5 1073741824" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:42 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5
Apr 13 17:12:42 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:42 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9add33cd-a7fc-452c-ae07-2a684253f10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994d44a0-6185-4f1b-9f87-a350b6cbc3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Volume volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5 (3486f827-de91-4a83-b0c0-faa27c5c5ef5): created successfully
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994d44a0-6185-4f1b-9f87-a350b6cbc3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Flow 'volume_create_manager' (2212050d-30c7-4569-a324-5d301c088307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b5ac564b-44c3-4bb1-a63c-2b0b31e73fc1 tempest-VolumesTransfersV355Test-786820260 None] Created volume successfully.
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Acquiring lock "cinder-3486f827-de91-4a83-b0c0-faa27c5c5ef5-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-3486f827-de91-4a83-b0c0-faa27c5c5ef5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Acquiring lock "cinder-quobyte-3486f827-de91-4a83-b0c0-faa27c5c5ef5" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-quobyte-3486f827-de91-4a83-b0c0-faa27c5c5ef5" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[388f1a44-f5d9-45fc-a7f9-8c34a21a1465]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:44 devstack sudo[89896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5
Apr 13 17:12:44 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:44 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:44 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5
Apr 13 17:12:44 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:45 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3486f827-de91-4a83-b0c0-faa27c5c5ef5" returned: 0 in 0.390s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-quobyte-3486f827-de91-4a83-b0c0-faa27c5c5ef5" released by "delete_volume" :: held 0.865s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Created reservations ['4a1bd08d-eeb5-41a6-ae5c-418d0305ac75', '4f1fb2e0-fb2b-4a80-a311-9744d9c02d38', '7ac1e2cf-3059-447b-a985-ec134e7f2ba2', 'b26d5712-90cf-4dff-b41e-9bd3ea36b867'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:45 devstack sudo[89904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:12:45 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:45 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:12:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Deleted volume successfully.
Apr 13 17:12:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a7434d70-4338-4c05-aa08-f494d5f57066 tempest-VolumesTransfersV355Test-1088081741 None] Lock "cinder-3486f827-de91-4a83-b0c0-faa27c5c5ef5-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Flow 'volume_create_manager' (25610599-1b42-47ef-9dd4-151db4e7f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc8166f-55d0-4750-9632-18004a0e2439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc8166f-55d0-4750-9632-18004a0e2439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1981739341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c71d7a-6008-4296-a518-aa6d1d432ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a725bf74154cd48a7642a83fc40d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:48Z,use_quota=True,user_id='828825742ada4a7ca708254ad92aa269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b31787-5072-44a3-bb52-37e7aa56e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b31787-5072-44a3-bb52-37e7aa56e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48147306-d100-4510-95d3-ecc07c788e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48147306-d100-4510-95d3-ecc07c788e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c71d7a-6008-4296-a518-aa6d1d432ef7', 'volume_name': 'volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a93998-fdc1-41b0-bd09-607dff64ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a93998-fdc1-41b0-bd09-607dff64ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535abde8-c115-4919-9659-ed5a9f456e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:48 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Volume e4c71d7a-6008-4296-a518-aa6d1d432ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7', 'volume_size': 1}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1981739341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c71d7a-6008-4296-a518-aa6d1d432ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a725bf74154cd48a7642a83fc40d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:12:48Z,use_quota=True,user_id='828825742ada4a7ca708254ad92aa269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Creating volume e4c71d7a-6008-4296-a518-aa6d1d432ef7 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:12:48 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:48 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7 1073741824
Apr 13 17:12:48 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:48 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7 1073741824" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:12:48 devstack sudo[89914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7
Apr 13 17:12:48 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:12:49 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root
Apr 13 17:12:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:12:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:12:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:12:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535abde8-c115-4919-9659-ed5a9f456e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fc0bfe-6767-4476-a3f4-f3244c7cb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:12:49 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Volume volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7 (e4c71d7a-6008-4296-a518-aa6d1d432ef7): created successfully
Apr 13 17:12:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fc0bfe-6767-4476-a3f4-f3244c7cb755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:12:49 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Flow 'volume_create_manager' (25610599-1b42-47ef-9dd4-151db4e7f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:12:49 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3cd649c4-7d9a-4cd5-adbf-62a14b294d16 tempest-VolumesNegativeTest-166265873 None] Created volume successfully.
Apr 13 17:12:59 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=72,cinder:UPDATE=102,cinder:DELETE=10,cinder:INSERT=19 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:12:59 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=47,cinder:UPDATE=69,cinder:DELETE=6,cinder:INSERT=18 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:12 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:13:12 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:12 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.444s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:12 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Acquiring lock "cinder-e4c71d7a-6008-4296-a518-aa6d1d432ef7-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Lock "cinder-e4c71d7a-6008-4296-a518-aa6d1d432ef7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Acquiring lock "cinder-quobyte-e4c71d7a-6008-4296-a518-aa6d1d432ef7" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Lock "cinder-quobyte-e4c71d7a-6008-4296-a518-aa6d1d432ef7" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b21b83-5e5c-47f1-8373-f7b8a2ca2f6c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:14 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7
Apr 13 17:13:14 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:14 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:14 devstack sudo[90060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7
Apr 13 17:13:14 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:15 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e4c71d7a-6008-4296-a518-aa6d1d432ef7" returned: 0 in 0.389s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Lock "cinder-quobyte-e4c71d7a-6008-4296-a518-aa6d1d432ef7" released by "delete_volume" :: held 0.851s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Created reservations ['530ad53a-2c1a-46b6-bd48-91097f1c4776', '2c079ae7-78b0-48f8-87c0-be5ce6918c22', '2ef7a6b5-d82d-491f-91e0-ed52162a4db2', '7348390c-1354-4731-a3b9-bb94b5bb8c0f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:15 devstack sudo[90063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:13:15 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:15 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:13:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Deleted volume successfully.
Apr 13 17:13:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d6f2bc36-478b-4ba7-aadf-cc27f38e474a tempest-VolumesNegativeTest-166265873 None] Lock "cinder-e4c71d7a-6008-4296-a518-aa6d1d432ef7-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (c80aadd1-4140-4898-ac19-7913b162af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e20bbbb-9ab3-4489-aa5b-daec1c9ba05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e20bbbb-9ab3-4489-aa5b-daec1c9ba05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1213927704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d9dd77-6561-4b26-8d47-d96b867a660a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:22Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec623dfa-330b-4f3e-989f-f5c54fe93298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec623dfa-330b-4f3e-989f-f5c54fe93298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388878ad-2423-4d15-9b38-3492823444a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388878ad-2423-4d15-9b38-3492823444a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d9dd77-6561-4b26-8d47-d96b867a660a', 'volume_name': 'volume-30d9dd77-6561-4b26-8d47-d96b867a660a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc5625e-348c-4630-9754-3514c5c6decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc5625e-348c-4630-9754-3514c5c6decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe899df0-384f-4e2f-8e5e-b898096db21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Volume 30d9dd77-6561-4b26-8d47-d96b867a660a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d9dd77-6561-4b26-8d47-d96b867a660a', 'volume_size': 1}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1213927704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d9dd77-6561-4b26-8d47-d96b867a660a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:22Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Creating volume 30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:13:21 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:13:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:21 devstack sudo[90068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a 1073741824
Apr 13 17:13:21 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:22 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a 1073741824" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:22 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a
Apr 13 17:13:22 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:22 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe899df0-384f-4e2f-8e5e-b898096db21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d9dd77-6561-4b26-8d47-d96b867a660a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce87c5d-5fc5-4a84-a4aa-763435dd3892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Volume volume-30d9dd77-6561-4b26-8d47-d96b867a660a (30d9dd77-6561-4b26-8d47-d96b867a660a): created successfully
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce87c5d-5fc5-4a84-a4aa-763435dd3892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (c80aadd1-4140-4898-ac19-7913b162af45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8038730c-2dfa-45a2-933a-45102a62b85f tempest-VolumesSnapshotTestJSON-1405304334 None] Created volume successfully.
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Creating offline snapshot 8d9462f8-729a-4503-830f-67e2f2a6f1fd of volume 30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8e22c-16b3-4a23-8380-4a31b31561ca]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:23 devstack sudo[90076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a
Apr 13 17:13:23 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:23 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:23 devstack sudo[90081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd 1G
Apr 13 17:13:23 devstack sudo[90081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:23 devstack sudo[90081]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd 1G" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d9dd77-6561-4b26-8d47-d96b867a660a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:23 devstack sudo[90086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d9dd77-6561-4b26-8d47-d96b867a660a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd
Apr 13 17:13:23 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:24 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d9dd77-6561-4b26-8d47-d96b867a660a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:24 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd is being set with open permissions: ugo+rw
Apr 13 17:13:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:24 devstack sudo[90091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd
Apr 13 17:13:24 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:24 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd" returned: 0 in 0.390s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:24 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.info
Apr 13 17:13:24 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:25 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.info" returned: 0 in 0.396s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:25 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.info is being set with open permissions: ugo+rw
Apr 13 17:13:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:25 devstack sudo[90097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.info
Apr 13 17:13:25 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:25 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.info" returned: 0 in 0.391s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-388152f2-f463-4fb4-9013-34e9f2fd9b59 tempest-VolumesSnapshotTestJSON-1405304334 None] Create snapshot completed successfully
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-8d9462f8-729a-4503-830f-67e2f2a6f1fd-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-8d9462f8-729a-4503-830f-67e2f2a6f1fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-30d9dd77-6561-4b26-8d47-d96b867a660a" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-30d9dd77-6561-4b26-8d47-d96b867a660a" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-8d9462f8-729a-4503-830f-67e2f2a6f1fd" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-8d9462f8-729a-4503-830f-67e2f2a6f1fd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Deleting offline snapshot 8d9462f8-729a-4503-830f-67e2f2a6f1fd of volume 30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] snapshot_file for this snap is: volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c6bb80-4b05-4542-a939-a1e162378744]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:26 devstack sudo[90100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd
Apr 13 17:13:26 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:26 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d9dd77-6561-4b26-8d47-d96b867a660a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[803773a5-e6bb-4e2d-903e-200f1b0a24fa]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:26 devstack sudo[90105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a
Apr 13 17:13:26 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:27 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:27 devstack sudo[90110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd
Apr 13 17:13:27 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:27 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd" returned: 0 in 0.428s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:27 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd
Apr 13 17:13:27 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:27 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a.8d9462f8-729a-4503-830f-67e2f2a6f1fd" returned: 0 in 0.394s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-8d9462f8-729a-4503-830f-67e2f2a6f1fd" released by "_delete_snapshot" :: held 1.772s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-30d9dd77-6561-4b26-8d47-d96b867a660a" released by "delete_snapshot" :: held 1.783s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['3ebfebfa-9c60-443e-8919-56c3b16b4739', 'bacee08c-c418-47f3-b8f5-c33018938841', 'd9728268-a39c-4a4a-b817-ed3a59435aa3', '44762b94-74cf-4338-a2b9-d16128642e80'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Delete snapshot completed successfully.
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95978fa7-833c-4ddd-a82e-67ae9f78918a tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-8d9462f8-729a-4503-830f-67e2f2a6f1fd-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (366d2ed1-15f3-4e2d-bf38-2571f6cee3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7458b99c-be41-404c-98ec-8d0e7c0ae236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7458b99c-be41-404c-98ec-8d0e7c0ae236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1610148727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49236d8-9233-4556-8015-4688aa21b636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:29Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edc9ecc-f9d9-46f7-8899-dd473ee03b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edc9ecc-f9d9-46f7-8899-dd473ee03b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c68989-094e-4e32-9cfc-5703dcbdcba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c68989-094e-4e32-9cfc-5703dcbdcba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49236d8-9233-4556-8015-4688aa21b636', 'volume_name': 'volume-e49236d8-9233-4556-8015-4688aa21b636', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0cedc3-0045-4d53-a243-db574c0be749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0cedc3-0045-4d53-a243-db574c0be749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5996b2bd-e7f8-4871-b286-dfdd0dc8998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Volume e49236d8-9233-4556-8015-4688aa21b636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49236d8-9233-4556-8015-4688aa21b636', 'volume_size': 1}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1610148727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49236d8-9233-4556-8015-4688aa21b636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:29Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Creating volume e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:13:28 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:13:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:28 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 1073741824
Apr 13 17:13:28 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:29 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 1073741824" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:29 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636
Apr 13 17:13:29 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:29 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636" returned: 0 in 0.393s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5996b2bd-e7f8-4871-b286-dfdd0dc8998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49236d8-9233-4556-8015-4688aa21b636', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c518dfc1-7c69-4599-b5de-65080ac9d828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Volume volume-e49236d8-9233-4556-8015-4688aa21b636 (e49236d8-9233-4556-8015-4688aa21b636): created successfully
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c518dfc1-7c69-4599-b5de-65080ac9d828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (366d2ed1-15f3-4e2d-bf38-2571f6cee3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-85e684c0-234c-4181-9e1f-5d2647016b1b tempest-VolumesSnapshotTestJSON-1405304334 None] Created volume successfully.
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Creating offline snapshot e8c13173-691f-496c-bad2-d63e728640a2 of volume e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[873ec024-507d-4fae-bcfa-abc89c56f36f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:29 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636
Apr 13 17:13:29 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:30 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636" returned: 0 in 0.444s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:30 devstack sudo[90132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 1G
Apr 13 17:13:30 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:30 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 1G" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49236d8-9233-4556-8015-4688aa21b636 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:30 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49236d8-9233-4556-8015-4688aa21b636 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2
Apr 13 17:13:30 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:31 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49236d8-9233-4556-8015-4688aa21b636 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2" returned: 0 in 0.410s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:31 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 is being set with open permissions: ugo+rw
Apr 13 17:13:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:31 devstack sudo[90142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2
Apr 13 17:13:31 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:31 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2" returned: 0 in 0.385s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:31 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.info
Apr 13 17:13:31 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:31 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.info" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:31 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.info is being set with open permissions: ugo+rw
Apr 13 17:13:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:31 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.info
Apr 13 17:13:31 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:32 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.info" returned: 0 in 0.394s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e1ef4cd0-b685-489c-9466-fb7351e7df46 tempest-VolumesSnapshotTestJSON-1405304334 None] Create snapshot completed successfully
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (193405cf-c63a-410f-b7cb-79f2f626e48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92eea16-265b-42d4-9ad7-e55ff4f89616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d92eea16-265b-42d4-9ad7-e55ff4f89616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1752784241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e001c28-0372-49a4-be8d-791f630b6ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e8c13173-691f-496c-bad2-d63e728640a2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:33Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cefc23-9cf1-46c0-b4cb-ef0530db2d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cefc23-9cf1-46c0-b4cb-ef0530db2d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab0eac-a465-49aa-925c-2c1a33dffdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab0eac-a465-49aa-925c-2c1a33dffdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8e001c28-0372-49a4-be8d-791f630b6ba3', 'volume_name': 'volume-8e001c28-0372-49a4-be8d-791f630b6ba3', 'volume_size': 2, 'snapshot_id': 'e8c13173-691f-496c-bad2-d63e728640a2'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf6c68-27c3-48dc-8601-097d18c5c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bf6c68-27c3-48dc-8601-097d18c5c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac202c8-e15a-49f6-a9c5-4bbe234c81b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Volume 8e001c28-0372-49a4-be8d-791f630b6ba3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8e001c28-0372-49a4-be8d-791f630b6ba3', 'volume_size': 2, 'snapshot_id': 'e8c13173-691f-496c-bad2-d63e728640a2'}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-e8c13173-691f-496c-bad2-d63e728640a2-8e001c28-0372-49a4-be8d-791f630b6ba3" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e8c13173-691f-496c-bad2-d63e728640a2-8e001c28-0372-49a4-be8d-791f630b6ba3" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Creating volume 8e001c28-0372-49a4-be8d-791f630b6ba3 from snapshot e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-8e001c28-0372-49a4-be8d-791f630b6ba3" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-8e001c28-0372-49a4-be8d-791f630b6ba3" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] snapshot: e8c13173-691f-496c-bad2-d63e728640a2, volume: 8e001c28-0372-49a4-be8d-791f630b6ba3,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[02242d12-ae6a-4c88-966f-fc04184fe724]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:33 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2
Apr 13 17:13:33 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:33 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e49236d8-9233-4556-8015-4688aa21b636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff539a3b-52f0-4a99-8d2f-9172225702a6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:33 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636
Apr 13 17:13:33 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:34 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636" returned: 0 in 0.456s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:34 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:13:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:34 devstack sudo[90161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3
Apr 13 17:13:34 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:35 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3" returned: 0 in 1.799s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:35 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d7ce3-20fa-450b-953b-82d672e689fa]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:35 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636
Apr 13 17:13:35 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:36 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636" returned: 0 in 0.564s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636, size 1024.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:13:36 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Converted 1024.00 MB image at 568.71 MB/s
Apr 13 17:13:36 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3 is being set with open permissions: ugo+rw
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:36 devstack sudo[90178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3
Apr 13 17:13:36 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:36 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-8e001c28-0372-49a4-be8d-791f630b6ba3" released by "_copy_volume_from_snapshot" :: held 3.717s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e8c13173-691f-496c-bad2-d63e728640a2-8e001c28-0372-49a4-be8d-791f630b6ba3" released by "_create_volume_from_snapshot" :: held 3.733s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.741s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac202c8-e15a-49f6-a9c5-4bbe234c81b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e001c28-0372-49a4-be8d-791f630b6ba3', 'volume_size': 2, 'snapshot_id': 'e8c13173-691f-496c-bad2-d63e728640a2'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d835aaf-b6c9-43e7-bb55-fde1ac4fbbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:36 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Volume volume-8e001c28-0372-49a4-be8d-791f630b6ba3 (8e001c28-0372-49a4-be8d-791f630b6ba3): created successfully
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d835aaf-b6c9-43e7-bb55-fde1ac4fbbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:36 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (193405cf-c63a-410f-b7cb-79f2f626e48d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:36 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c0177f1d-374f-4468-b8c3-201f474d2bd8 tempest-VolumesSnapshotTestJSON-1405304334 None] Created volume successfully.
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-8e001c28-0372-49a4-be8d-791f630b6ba3-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-8e001c28-0372-49a4-be8d-791f630b6ba3-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-8e001c28-0372-49a4-be8d-791f630b6ba3" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-8e001c28-0372-49a4-be8d-791f630b6ba3" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4924b281-8f37-4389-86a6-0fe57adfec8d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:37 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3
Apr 13 17:13:37 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:37 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3" returned: 0 in 0.444s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:37 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3
Apr 13 17:13:37 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:38 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e001c28-0372-49a4-be8d-791f630b6ba3" returned: 0 in 0.397s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-8e001c28-0372-49a4-be8d-791f630b6ba3" released by "delete_volume" :: held 0.865s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['ba637f17-4367-4660-9fab-a2c394da0c94', 'fa63b6b4-83e4-4d6d-bcce-ce77e7fd212e', '374eaf81-d8f2-4849-9132-9638303de3e1', 'c7d2da44-dddf-4542-b666-562b071bb353'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:38 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:13:38 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-e8c13173-691f-496c-bad2-d63e728640a2-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-e8c13173-691f-496c-bad2-d63e728640a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-e49236d8-9233-4556-8015-4688aa21b636" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e49236d8-9233-4556-8015-4688aa21b636" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-e8c13173-691f-496c-bad2-d63e728640a2" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e8c13173-691f-496c-bad2-d63e728640a2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Deleting offline snapshot e8c13173-691f-496c-bad2-d63e728640a2 of volume e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] snapshot_file for this snap is: volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd30136-f782-4ce2-b45e-d84e0d321d11]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:38 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2
Apr 13 17:13:38 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:38 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.433s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:13:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Deleted volume successfully.
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5b7aa961-ec3b-4e59-8ff6-ba38e2e2963d tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-8e001c28-0372-49a4-be8d-791f630b6ba3-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:38 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e49236d8-9233-4556-8015-4688aa21b636(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[81adab2a-4eb4-468c-b7b9-91e597e19ead]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:39 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636
Apr 13 17:13:39 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:39 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:39 devstack sudo[90203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2
Apr 13 17:13:39 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:39 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2" returned: 0 in 0.444s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:39 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2
Apr 13 17:13:39 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:40 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636.e8c13173-691f-496c-bad2-d63e728640a2" returned: 0 in 0.383s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e8c13173-691f-496c-bad2-d63e728640a2" released by "_delete_snapshot" :: held 1.778s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e49236d8-9233-4556-8015-4688aa21b636" released by "delete_snapshot" :: held 1.789s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['992dc5fc-4081-4321-a0aa-9d6dfc854c4e', '1105c4cd-14a3-4fcd-b67d-54f3d14130d2', 'ab5b68af-bf7e-4e2d-894a-174e72169a85', '47ab228d-70ad-44fd-8810-f7f95215e425'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Delete snapshot completed successfully.
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8502b059-9704-47c2-ac5b-7a6ec46a86b6 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-e8c13173-691f-496c-bad2-d63e728640a2-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-e49236d8-9233-4556-8015-4688aa21b636-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-e49236d8-9233-4556-8015-4688aa21b636-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-e49236d8-9233-4556-8015-4688aa21b636" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e49236d8-9233-4556-8015-4688aa21b636" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9098c39b-a116-4ee4-b0f5-4b88886ecce6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:40 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636
Apr 13 17:13:40 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:41 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:41 devstack sudo[90216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636
Apr 13 17:13:41 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:41 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e49236d8-9233-4556-8015-4688aa21b636" returned: 0 in 0.388s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-e49236d8-9233-4556-8015-4688aa21b636" released by "delete_volume" :: held 0.874s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['403ccd89-c9c2-4637-bd3f-ace4822670a0', '6fe8ed3d-10c3-42d4-a527-41026baf490c', 'b09b9862-0c45-4c73-88c9-a25c2b2973d3', 'd9b013f6-6bd3-43ca-a4ba-36ca5108a2b1'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:41 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:13:41 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (681e8132-2cd6-442a-b7bb-1c43aac06fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185de068-8769-4290-bb61-b1b856ba7d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (185de068-8769-4290-bb61-b1b856ba7d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1392892389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f0fc17-7512-43ad-a52f-ff0b198bcf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:42Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda496e3-3fa7-482d-a9b0-52d573f6f68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda496e3-3fa7-482d-a9b0-52d573f6f68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0148b28e-e97e-40c4-802d-82e88e53670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0148b28e-e97e-40c4-802d-82e88e53670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f0fc17-7512-43ad-a52f-ff0b198bcf7a', 'volume_name': 'volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac4212f-e6d5-43a4-80ec-9a61a9b46cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac4212f-e6d5-43a4-80ec-9a61a9b46cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4e0e45-a828-4cbd-bc33-2fde60126dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Volume 88f0fc17-7512-43ad-a52f-ff0b198bcf7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a', 'volume_size': 1}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1392892389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f0fc17-7512-43ad-a52f-ff0b198bcf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:42Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Creating volume 88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:13:42 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:42 devstack sudo[90222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a 1073741824
Apr 13 17:13:42 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:42 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:13:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Deleted volume successfully.
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-27995aa8-76e6-41c4-84d6-bad3d7eb95ee tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-e49236d8-9233-4556-8015-4688aa21b636-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:42 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a 1073741824" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:42 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a
Apr 13 17:13:42 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:42 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" returned: 0 in 0.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4e0e45-a828-4cbd-bc33-2fde60126dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30d6993-3996-4bf3-9359-bc1726bb8f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:42 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Volume volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a (88f0fc17-7512-43ad-a52f-ff0b198bcf7a): created successfully
Apr 13 17:13:42 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30d6993-3996-4bf3-9359-bc1726bb8f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (681e8132-2cd6-442a-b7bb-1c43aac06fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:43 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-fee86cbb-3a70-478a-b7c9-17736b57f723 tempest-VolumesSnapshotTestJSON-1405304334 None] Created volume successfully.
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Creating offline snapshot b56b4948-ca8e-48ea-aca5-bb7a2101ce2e of volume 88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d696cbfe-7194-485d-9d6d-f538b4806150]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:43 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a
Apr 13 17:13:43 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:43 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:43 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e 1G
Apr 13 17:13:43 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:44 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e 1G" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:44 devstack sudo[90240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e
Apr 13 17:13:44 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:44 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:44 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e is being set with open permissions: ugo+rw
Apr 13 17:13:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:44 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e
Apr 13 17:13:44 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:44 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" returned: 0 in 0.386s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:44 devstack sudo[90248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.info
Apr 13 17:13:44 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:45 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.info" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:45 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.info is being set with open permissions: ugo+rw
Apr 13 17:13:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:45 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.info
Apr 13 17:13:45 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:45 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.info" returned: 0 in 0.382s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-365fccda-3ef8-4623-a3f8-12d5b141d9cb tempest-VolumesSnapshotTestJSON-1405304334 None] Create snapshot completed successfully
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (115cb9a5-5ff5-4e92-88c7-51a6cc1b77f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da13d71a-7369-4138-9f85-edcd568f84a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da13d71a-7369-4138-9f85-edcd568f84a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-380622704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88372c9d-dd09-4960-a971-94fbd8426ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a232bf2f0a944359be60108c7101f986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b56b4948-ca8e-48ea-aca5-bb7a2101ce2e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:13:47Z,use_quota=True,user_id='4e0ac07b121d4489a33677b663382814',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad83b51-3706-4254-b759-e5adc1bf35f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad83b51-3706-4254-b759-e5adc1bf35f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7284bec-6277-4d08-b6be-c83880b24417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7284bec-6277-4d08-b6be-c83880b24417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88372c9d-dd09-4960-a971-94fbd8426ccc', 'volume_name': 'volume-88372c9d-dd09-4960-a971-94fbd8426ccc', 'volume_size': 1, 'snapshot_id': 'b56b4948-ca8e-48ea-aca5-bb7a2101ce2e'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a9ef5-10c0-472f-b4f0-98ff85264f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a9ef5-10c0-472f-b4f0-98ff85264f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6561835-7595-43d3-b507-9d1d90ec19e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Volume 88372c9d-dd09-4960-a971-94fbd8426ccc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88372c9d-dd09-4960-a971-94fbd8426ccc', 'volume_size': 1, 'snapshot_id': 'b56b4948-ca8e-48ea-aca5-bb7a2101ce2e'}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e-88372c9d-dd09-4960-a971-94fbd8426ccc" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e-88372c9d-dd09-4960-a971-94fbd8426ccc" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Creating volume 88372c9d-dd09-4960-a971-94fbd8426ccc from snapshot b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-88372c9d-dd09-4960-a971-94fbd8426ccc" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88372c9d-dd09-4960-a971-94fbd8426ccc" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] snapshot: b56b4948-ca8e-48ea-aca5-bb7a2101ce2e, volume: 88372c9d-dd09-4960-a971-94fbd8426ccc,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1560cf-4708-45e3-8abe-6b71cd45c2ec]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:46 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e
Apr 13 17:13:46 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:47 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba948e4-1a85-4b7e-aa71-f46435394d97]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:47 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a
Apr 13 17:13:47 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:47 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:13:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:47 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc
Apr 13 17:13:47 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:49 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc" returned: 0 in 1.793s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c452d53-d663-4344-bc67-644616a3db9e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:49 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a
Apr 13 17:13:49 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:49 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" returned: 0 in 0.595s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:49 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:13:49 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Converted 1024.00 MB image at 570.84 MB/s
Apr 13 17:13:49 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc is being set with open permissions: ugo+rw
Apr 13 17:13:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:50 devstack sudo[90284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc
Apr 13 17:13:50 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:50 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88372c9d-dd09-4960-a971-94fbd8426ccc" released by "_copy_volume_from_snapshot" :: held 3.770s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e-88372c9d-dd09-4960-a971-94fbd8426ccc" released by "_create_volume_from_snapshot" :: held 3.786s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.794s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6561835-7595-43d3-b507-9d1d90ec19e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88372c9d-dd09-4960-a971-94fbd8426ccc', 'volume_size': 1, 'snapshot_id': 'b56b4948-ca8e-48ea-aca5-bb7a2101ce2e'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6d466-54d8-4ff9-aa80-1f426585e47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:13:50 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Volume volume-88372c9d-dd09-4960-a971-94fbd8426ccc (88372c9d-dd09-4960-a971-94fbd8426ccc): created successfully
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6d466-54d8-4ff9-aa80-1f426585e47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Flow 'volume_create_manager' (115cb9a5-5ff5-4e92-88c7-51a6cc1b77f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:13:50 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b20a8c7e-0d79-40be-b109-d6c85c9c6e8f tempest-VolumesSnapshotTestJSON-1405304334 None] Created volume successfully.
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-88372c9d-dd09-4960-a971-94fbd8426ccc-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-88372c9d-dd09-4960-a971-94fbd8426ccc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-88372c9d-dd09-4960-a971-94fbd8426ccc" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88372c9d-dd09-4960-a971-94fbd8426ccc" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1e0f5-8ea0-405f-8eb7-8fda61d625c8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:50 devstack sudo[90293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc
Apr 13 17:13:50 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:51 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:51 devstack sudo[90298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc
Apr 13 17:13:51 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:51 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88372c9d-dd09-4960-a971-94fbd8426ccc" returned: 0 in 0.390s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88372c9d-dd09-4960-a971-94fbd8426ccc" released by "delete_volume" :: held 0.862s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['aa5a606e-b174-4172-98f5-fa78474d38ba', '01440ba9-0949-47dc-86f8-12c8a60e015f', 'c20b575a-619b-412e-a9c2-542fd2207820', '5b0454aa-4118-4e68-90aa-faea388559a1'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:51 devstack sudo[90301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:13:51 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Deleting offline snapshot b56b4948-ca8e-48ea-aca5-bb7a2101ce2e of volume 88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] snapshot_file for this snap is: volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae254466-1637-421e-9c08-7353fba15b62]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:52 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e
Apr 13 17:13:52 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:52 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.429s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:13:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Deleted volume successfully.
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-15ce65f1-21d7-42e3-9338-1fc97b80bdfc tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-88372c9d-dd09-4960-a971-94fbd8426ccc-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:52 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e43a87-5180-4d60-918a-6ca2b993e17a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:52 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a
Apr 13 17:13:52 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:52 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:52 devstack sudo[90314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e
Apr 13 17:13:52 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:53 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" returned: 0 in 0.445s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:53 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e
Apr 13 17:13:53 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:53 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a.b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e" released by "_delete_snapshot" :: held 1.818s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" released by "delete_snapshot" :: held 1.832s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:53 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['0ea3810b-a655-4f37-af83-da525a0e067e', 'c2703f97-4754-4ce3-bd59-40aedf890408', 'e215ce47-ad41-43ba-b50c-b530b1ab7e0c', '8b4d96d4-4342-424f-adbb-ee34a88c00a5'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Delete snapshot completed successfully.
Apr 13 17:13:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-10e3d34e-4066-4566-b7e0-2d47928a1842 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-b56b4948-ca8e-48ea-aca5-bb7a2101ce2e-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-88f0fc17-7512-43ad-a52f-ff0b198bcf7a-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-88f0fc17-7512-43ad-a52f-ff0b198bcf7a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc9fdd-7af3-4b8c-b12c-37eb169caa07]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:54 devstack sudo[90322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a
Apr 13 17:13:54 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:54 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:54 devstack sudo[90327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a
Apr 13 17:13:54 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:55 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" returned: 0 in 0.403s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-88f0fc17-7512-43ad-a52f-ff0b198bcf7a" released by "delete_volume" :: held 0.921s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['de6fbc82-0ccb-4917-9bc2-3430166ddb47', 'e102e20f-9b32-44d9-b3ea-6302028b2615', '96070b8d-1738-41dd-80e0-5304c5b884b8', 'dcf7db58-c0e8-4c40-a66e-fbb9a50aaa92'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:55 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:13:55 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-30d9dd77-6561-4b26-8d47-d96b867a660a-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-30d9dd77-6561-4b26-8d47-d96b867a660a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "cinder-quobyte-30d9dd77-6561-4b26-8d47-d96b867a660a" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-30d9dd77-6561-4b26-8d47-d96b867a660a" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb902841-ea38-472e-b181-a277aaafa85e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:55 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a
Apr 13 17:13:55 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:55 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:13:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Deleted volume successfully.
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-3ee8b040-e2b8-4b25-b666-16edd7ee1b74 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-88f0fc17-7512-43ad-a52f-ff0b198bcf7a-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:55 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:55 devstack sudo[90338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a
Apr 13 17:13:55 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:56 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-30d9dd77-6561-4b26-8d47-d96b867a660a" returned: 0 in 0.393s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-quobyte-30d9dd77-6561-4b26-8d47-d96b867a660a" released by "delete_volume" :: held 0.866s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Created reservations ['40c88e32-aabf-4302-916f-88a1f698a85a', 'c7148c1e-920f-4d2d-b926-3ab7c4108ac5', 'c00fca3f-83c0-4fc0-aa54-916859d5bf56', 'e0e79c27-9cb3-4ac6-bc24-f29aafb83af2'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:13:56 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:13:56 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:13:56 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.441s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:13:56 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Deleted volume successfully.
Apr 13 17:13:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1f293f45-87e2-48f1-afdf-dce9b9ab5df1 tempest-VolumesSnapshotTestJSON-1405304334 None] Lock "cinder-30d9dd77-6561-4b26-8d47-d96b867a660a-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Flow 'volume_create_manager' (c980a97f-a05b-48a4-997a-0478c8d524bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d26cd9-61aa-4718-89d5-68d31c0f1e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d26cd9-61aa-4718-89d5-68d31c0f1e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-256505797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1a5cd7-a116-44c2-a42f-aec2901dc658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785ae790fbc4bd0b88a4cfdc1b1360d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:00Z,use_quota=True,user_id='a45a5efbf4dd4ea5bbc2fb42d451bdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262ed65f-7e9b-48fe-897b-b1819c0ca918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262ed65f-7e9b-48fe-897b-b1819c0ca918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf2a566-a72f-4b46-b14d-bfe6af6895fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf2a566-a72f-4b46-b14d-bfe6af6895fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1a5cd7-a116-44c2-a42f-aec2901dc658', 'volume_name': 'volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3c5ade-59a4-4851-8fb1-9a5227c2176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3c5ade-59a4-4851-8fb1-9a5227c2176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc052d3c-9cf0-48ff-af6a-42faf0a1a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:00 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Volume 3d1a5cd7-a116-44c2-a42f-aec2901dc658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658', 'volume_size': 2}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-256505797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1a5cd7-a116-44c2-a42f-aec2901dc658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c785ae790fbc4bd0b88a4cfdc1b1360d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:00Z,use_quota=True,user_id='a45a5efbf4dd4ea5bbc2fb42d451bdac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Creating volume 3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:00 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 2147483648 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:00 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 2147483648
Apr 13 17:14:00 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:00 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 2147483648" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:01 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658
Apr 13 17:14:01 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:01 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658" returned: 0 in 0.405s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc052d3c-9cf0-48ff-af6a-42faf0a1a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658', 'volume_size': 2}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5613f151-c404-49dd-b1d0-7bf60269d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:01 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Volume volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 (3d1a5cd7-a116-44c2-a42f-aec2901dc658): created successfully
Apr 13 17:14:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5613f151-c404-49dd-b1d0-7bf60269d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:01 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Flow 'volume_create_manager' (c980a97f-a05b-48a4-997a-0478c8d524bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-947403aa-32ae-45a5-80ea-bff74de1e73f tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Created volume successfully.
Apr 13 17:14:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Creating offline snapshot d5ce19ae-14c5-4c41-ba70-e7ae31737311 of volume 3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:14:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e400b0-4fa2-4087-b950-e52c37039d8b]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:02 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658
Apr 13 17:14:02 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:03 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 2G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:03 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 2G
Apr 13 17:14:03 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:03 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 2G" returned: 0 in 0.447s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:03 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311
Apr 13 17:14:03 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:03 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311" returned: 0 in 0.408s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:03 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 is being set with open permissions: ugo+rw
Apr 13 17:14:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:03 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311
Apr 13 17:14:03 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:04 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311" returned: 0 in 0.386s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:04 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.info
Apr 13 17:14:04 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:04 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.info" returned: 0 in 0.404s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:04 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.info is being set with open permissions: ugo+rw
Apr 13 17:14:04 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:04 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.info
Apr 13 17:14:04 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:05 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.info" returned: 0 in 0.387s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:05 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-80b5fdbc-9959-434a-a2b4-89312f6cc314 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Create snapshot completed successfully
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "cinder-d5ce19ae-14c5-4c41-ba70-e7ae31737311-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-d5ce19ae-14c5-4c41-ba70-e7ae31737311-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "cinder-quobyte-3d1a5cd7-a116-44c2-a42f-aec2901dc658" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-quobyte-3d1a5cd7-a116-44c2-a42f-aec2901dc658" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "cinder-quobyte-d5ce19ae-14c5-4c41-ba70-e7ae31737311" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-quobyte-d5ce19ae-14c5-4c41-ba70-e7ae31737311" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Deleting offline snapshot d5ce19ae-14c5-4c41-ba70-e7ae31737311 of volume 3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] snapshot_file for this snap is: volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d24a843-7c18-4f73-ac1d-a94195c9d1ef]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:05 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311
Apr 13 17:14:05 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:06 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311" returned: 0 in 0.455s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:14:06 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c11629-e58f-4333-bd04-e6a211ec9fb8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:06 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658
Apr 13 17:14:06 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:06 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:06 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311
Apr 13 17:14:06 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:07 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311" returned: 0 in 0.425s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:07 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311
Apr 13 17:14:07 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:07 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658.d5ce19ae-14c5-4c41-ba70-e7ae31737311" returned: 0 in 0.389s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-quobyte-d5ce19ae-14c5-4c41-ba70-e7ae31737311" released by "_delete_snapshot" :: held 1.766s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-quobyte-3d1a5cd7-a116-44c2-a42f-aec2901dc658" released by "delete_snapshot" :: held 1.778s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Created reservations ['cb455d11-03f8-49f3-9844-02d6834933fe', 'f8854602-15d0-4cf8-91a6-bd49b243e2bc', '12ed4d19-0113-4433-968d-87a0cada1dbd', '62ab483a-c715-4641-97db-a6f1fc4dc51e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Delete snapshot completed successfully.
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7a7b524c-0be7-4a70-b7e2-3d4a887ae360 tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-d5ce19ae-14c5-4c41-ba70-e7ae31737311-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "cinder-3d1a5cd7-a116-44c2-a42f-aec2901dc658-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-3d1a5cd7-a116-44c2-a42f-aec2901dc658-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "cinder-quobyte-3d1a5cd7-a116-44c2-a42f-aec2901dc658" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-quobyte-3d1a5cd7-a116-44c2-a42f-aec2901dc658" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e1c389-92cc-44e0-9cd4-c12805c8baa8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:08 devstack sudo[90433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658
Apr 13 17:14:08 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:08 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:08 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658
Apr 13 17:14:08 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:08 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3d1a5cd7-a116-44c2-a42f-aec2901dc658" returned: 0 in 0.383s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-quobyte-3d1a5cd7-a116-44c2-a42f-aec2901dc658" released by "delete_volume" :: held 0.852s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Created reservations ['d51b74a9-e604-4991-9b37-6eca345c95ec', '7012f546-ebf4-4b17-a229-54bb327dc943', '420ae08f-c2e6-421b-90cd-61895be1aff3', 'cf186d27-b25d-4a48-889a-7dcb0b602307'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:08 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:08 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:09 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:09 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Deleted volume successfully.
Apr 13 17:14:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-a1182277-0248-4e65-af06-79e3447c1ced tempest-VolumesSnapshotNegativeTestJSON-751212797 None] Lock "cinder-3d1a5cd7-a116-44c2-a42f-aec2901dc658-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=107,cinder:SELECT=95,cinder:INSERT=33,cinder:DELETE=8 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=87,cinder:INSERT=19,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (719c536e-cd4c-4ff4-99e8-da2cf9faf991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f27ea1f-7e8b-44e4-955c-46dc39f6ced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f27ea1f-7e8b-44e4-955c-46dc39f6ced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411674695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bf0615-f094-4acc-aec6-1234b5b86945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3a0479-1f15-4fe5-87b8-9dbd521ddfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3a0479-1f15-4fe5-87b8-9dbd521ddfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb56f52-8529-497b-aa1b-3a6f7ad4967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb56f52-8529-497b-aa1b-3a6f7ad4967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7bf0615-f094-4acc-aec6-1234b5b86945', 'volume_name': 'volume-e7bf0615-f094-4acc-aec6-1234b5b86945', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f39de27-bec4-4495-80c5-b75085eb7ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f39de27-bec4-4495-80c5-b75085eb7ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4696aaa7-fdd1-42cc-bc10-2f37809dd969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Volume e7bf0615-f094-4acc-aec6-1234b5b86945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7bf0615-f094-4acc-aec6-1234b5b86945', 'volume_size': 1}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411674695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7bf0615-f094-4acc-aec6-1234b5b86945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Creating volume e7bf0615-f094-4acc-aec6-1234b5b86945 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:10 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:10 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945 1073741824
Apr 13 17:14:10 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (44b72bd7-5ac8-4647-8026-dde5a1f79987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1d9ecb-c45e-4262-8327-c2be21938ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1d9ecb-c45e-4262-8327-c2be21938ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403552469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e486757-20e3-4151-beb4-4013aaba9788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de21abde-8b50-46d9-9916-571506a1169a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de21abde-8b50-46d9-9916-571506a1169a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9cb7e6-2f51-451d-a8bb-c90cb4540f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee9cb7e6-2f51-451d-a8bb-c90cb4540f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e486757-20e3-4151-beb4-4013aaba9788', 'volume_name': 'volume-8e486757-20e3-4151-beb4-4013aaba9788', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a568fb-2cb7-4bfc-86c7-faa4eb5f7792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a568fb-2cb7-4bfc-86c7-faa4eb5f7792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae716e-bea4-4371-a908-e6b00d1b3dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Volume 8e486757-20e3-4151-beb4-4013aaba9788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e486757-20e3-4151-beb4-4013aaba9788', 'volume_size': 1}
Apr 13 17:14:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (10807316-e1c0-4838-ac26-c8a050948419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf6577c-5664-4256-a842-3bd87704c0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf6577c-5664-4256-a842-3bd87704c0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843151426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515bad33-44e6-471f-af05-0ee329e17cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e0ef2e-a600-41b0-9af9-ca5d7fd9fde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73e0ef2e-a600-41b0-9af9-ca5d7fd9fde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c924f91-92da-4d8e-a02d-80a50c82c0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c924f91-92da-4d8e-a02d-80a50c82c0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515bad33-44e6-471f-af05-0ee329e17cad', 'volume_name': 'volume-515bad33-44e6-471f-af05-0ee329e17cad', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d62253-3be6-41f0-bc1e-5e945a89219d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d62253-3be6-41f0-bc1e-5e945a89219d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf2eb64-d299-4832-b761-a8157b2b6f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Volume 515bad33-44e6-471f-af05-0ee329e17cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515bad33-44e6-471f-af05-0ee329e17cad', 'volume_size': 1}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:11 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945 1073741824" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:11 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945
Apr 13 17:14:11 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (9c162f0b-8dac-4e07-b8a3-e8e063a88497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddee137-0504-4620-b338-5f3297be8194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddee137-0504-4620-b338-5f3297be8194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589714077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66327c54-438f-4103-8a65-9e199e06bd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef83cc9-0582-41ba-9602-6eef03e3cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef83cc9-0582-41ba-9602-6eef03e3cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4ac101-df89-4a27-b916-70fe1cc51ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4ac101-df89-4a27-b916-70fe1cc51ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66327c54-438f-4103-8a65-9e199e06bd27', 'volume_name': 'volume-66327c54-438f-4103-8a65-9e199e06bd27', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8d4121-2f6f-4e3d-ad5e-05aa6ca2d357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8d4121-2f6f-4e3d-ad5e-05aa6ca2d357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e554814d-85f2-496f-aeba-36333f555f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Volume 66327c54-438f-4103-8a65-9e199e06bd27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66327c54-438f-4103-8a65-9e199e06bd27', 'volume_size': 1}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (5374e031-0990-444e-8873-36970bdd9941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0a7ed9-5ccf-4099-be0d-cc439c157467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0a7ed9-5ccf-4099-be0d-cc439c157467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1676016964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fee62f7-7f89-4fce-b031-4de1fca3b8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7057ed0-8d55-4132-a880-0be4c69197b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7057ed0-8d55-4132-a880-0be4c69197b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e7b43b-9468-4291-9b33-9562bd8ea6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e7b43b-9468-4291-9b33-9562bd8ea6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fee62f7-7f89-4fce-b031-4de1fca3b8d7', 'volume_name': 'volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a92198c-a378-4219-a079-77186b1f935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a92198c-a378-4219-a079-77186b1f935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea49150-5887-4186-b43b-33f23c83f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Volume 8fee62f7-7f89-4fce-b031-4de1fca3b8d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7', 'volume_size': 1}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:11 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403552469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e486757-20e3-4151-beb4-4013aaba9788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Creating volume 8e486757-20e3-4151-beb4-4013aaba9788 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:11 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4696aaa7-fdd1-42cc-bc10-2f37809dd969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bf0615-f094-4acc-aec6-1234b5b86945', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack sudo[90453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788 1073741824
Apr 13 17:14:11 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2c0446-e70a-443d-b006-69a4cdc0b8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Volume volume-e7bf0615-f094-4acc-aec6-1234b5b86945 (e7bf0615-f094-4acc-aec6-1234b5b86945): created successfully
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e2c0446-e70a-443d-b006-69a4cdc0b8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (719c536e-cd4c-4ff4-99e8-da2cf9faf991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-70f6e89d-e81c-48f8-86fd-ae8ec2658dd7 tempest-CreateVolumesFromImageTest-726788342 None] Created volume successfully.
Apr 13 17:14:12 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788 1073741824" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:12 devstack sudo[90458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788
Apr 13 17:14:12 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:12 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788" returned: 0 in 0.406s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.465s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843151426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515bad33-44e6-471f-af05-0ee329e17cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Creating volume 515bad33-44e6-471f-af05-0ee329e17cad {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:12 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:12 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:12 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ae716e-bea4-4371-a908-e6b00d1b3dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e486757-20e3-4151-beb4-4013aaba9788', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:12 devstack sudo[90463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad 1073741824
Apr 13 17:14:12 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de24418-61a2-4c33-82b6-ee9a2e786f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Volume volume-8e486757-20e3-4151-beb4-4013aaba9788 (8e486757-20e3-4151-beb4-4013aaba9788): created successfully
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de24418-61a2-4c33-82b6-ee9a2e786f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (44b72bd7-5ac8-4647-8026-dde5a1f79987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f4854f99-a0d2-4353-a738-adbd0a894dd1 tempest-CreateVolumesFromImageTest-726788342 None] Created volume successfully.
Apr 13 17:14:12 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.406s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:12 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:13 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad 1073741824" returned: 0 in 0.481s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:13 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad
Apr 13 17:14:13 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:13 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.167s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589714077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66327c54-438f-4103-8a65-9e199e06bd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Creating volume 66327c54-438f-4103-8a65-9e199e06bd27 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:13 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf2eb64-d299-4832-b761-a8157b2b6f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515bad33-44e6-471f-af05-0ee329e17cad', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:13 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27 1073741824
Apr 13 17:14:13 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbe66cb-00d9-4422-8702-3285cdf6da8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:13 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Volume volume-515bad33-44e6-471f-af05-0ee329e17cad (515bad33-44e6-471f-af05-0ee329e17cad): created successfully
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbe66cb-00d9-4422-8702-3285cdf6da8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (10807316-e1c0-4838-ac26-c8a050948419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:13 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-80ede255-43e3-4918-b2b0-d94df349aa20 tempest-CreateVolumesFromImageTest-726788342 None] Created volume successfully.
Apr 13 17:14:13 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27 1073741824" returned: 0 in 0.477s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:14 devstack sudo[90477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27
Apr 13 17:14:14 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:14 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27" returned: 0 in 0.409s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.902s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1676016964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fee62f7-7f89-4fce-b031-4de1fca3b8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4204809fd9481eb7b4f866150cd35d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:11Z,use_quota=True,user_id='dd50e84de2f74d99920244c8864943dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Creating volume 8fee62f7-7f89-4fce-b031-4de1fca3b8d7 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:14 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e554814d-85f2-496f-aeba-36333f555f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66327c54-438f-4103-8a65-9e199e06bd27', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae8913b-4d3a-4bfe-8bc2-aa6c910a65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:14 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7 1073741824
Apr 13 17:14:14 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:14 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Volume volume-66327c54-438f-4103-8a65-9e199e06bd27 (66327c54-438f-4103-8a65-9e199e06bd27): created successfully
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ae8913b-4d3a-4bfe-8bc2-aa6c910a65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (9c162f0b-8dac-4e07-b8a3-e8e063a88497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7c2a8e0a-db76-4977-90f2-a6772312921c tempest-CreateVolumesFromImageTest-726788342 None] Created volume successfully.
Apr 13 17:14:14 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7 1073741824" returned: 0 in 0.476s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:14 devstack sudo[90485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7
Apr 13 17:14:14 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:15 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7" returned: 0 in 0.412s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ea49150-5887-4186-b43b-33f23c83f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c71fb2a-9370-4c9e-a578-1a0c0405d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:15 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Volume volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7 (8fee62f7-7f89-4fce-b031-4de1fca3b8d7): created successfully
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c71fb2a-9370-4c9e-a578-1a0c0405d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Flow 'volume_create_manager' (5374e031-0990-444e-8873-36970bdd9941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:15 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b9d4b37c-33e4-4db2-978a-d8fe6c8a7ff1 tempest-CreateVolumesFromImageTest-726788342 None] Created volume successfully.
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-8fee62f7-7f89-4fce-b031-4de1fca3b8d7-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-8fee62f7-7f89-4fce-b031-4de1fca3b8d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-quobyte-8fee62f7-7f89-4fce-b031-4de1fca3b8d7" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-8fee62f7-7f89-4fce-b031-4de1fca3b8d7" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad72bba-2905-4113-93fa-c97f76fb846a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:15 devstack sudo[90488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7
Apr 13 17:14:15 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:16 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:16 devstack sudo[90493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7
Apr 13 17:14:16 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:16 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8fee62f7-7f89-4fce-b031-4de1fca3b8d7" returned: 0 in 0.391s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-8fee62f7-7f89-4fce-b031-4de1fca3b8d7" released by "delete_volume" :: held 0.880s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Created reservations ['95e4e1c5-30d9-4bde-896c-a7b48afc0df5', '21908a3c-a2bb-428b-a7b2-6bd65537385e', '55561d39-c640-4d6f-8ff3-33ddaabc150a', '1c7dfbe8-6d8f-46b6-a9be-c85459ffca2a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:16 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:16 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-66327c54-438f-4103-8a65-9e199e06bd27-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-66327c54-438f-4103-8a65-9e199e06bd27-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-quobyte-66327c54-438f-4103-8a65-9e199e06bd27" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-66327c54-438f-4103-8a65-9e199e06bd27" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb108e41-01d2-46a2-9176-96399bd58b63]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:17 devstack sudo[90498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27
Apr 13 17:14:17 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:17 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:17 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Deleted volume successfully.
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0e6892b0-b306-42c6-b441-fe5e5cf949a7 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-8fee62f7-7f89-4fce-b031-4de1fca3b8d7-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:17 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:17 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27
Apr 13 17:14:17 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:17 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-66327c54-438f-4103-8a65-9e199e06bd27" returned: 0 in 0.401s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-66327c54-438f-4103-8a65-9e199e06bd27" released by "delete_volume" :: held 0.881s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Created reservations ['0075064d-d2e3-46ee-92bc-aefd1c8fc957', '36907443-8609-455d-8c2d-00b11ed51dec', 'f8c7c97d-3ed8-4093-b302-b91ae111136c', '266624d3-368d-4e71-a932-362ce4b1ae1b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:17 devstack sudo[90507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:17 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-515bad33-44e6-471f-af05-0ee329e17cad-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-515bad33-44e6-471f-af05-0ee329e17cad-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-quobyte-515bad33-44e6-471f-af05-0ee329e17cad" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-515bad33-44e6-471f-af05-0ee329e17cad" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c182da-6ae4-4c4c-977c-2b46ff4c1c16]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:18 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad
Apr 13 17:14:18 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:18 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:18 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Deleted volume successfully.
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-95256351-e3d8-4407-a7db-702c40ab27bd tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-66327c54-438f-4103-8a65-9e199e06bd27-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:18 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:18 devstack sudo[90515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad
Apr 13 17:14:18 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:18 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515bad33-44e6-471f-af05-0ee329e17cad" returned: 0 in 0.375s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-515bad33-44e6-471f-af05-0ee329e17cad" released by "delete_volume" :: held 0.877s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:18 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Created reservations ['f74dcc1d-d8bd-42c5-925b-b3d9f2fc3bf1', '5dc9b804-2633-4c38-aae7-e5ec9e1a9e7d', 'f5fbadb6-0615-474b-a76c-3a95bbfe1dde', '734a85a8-444d-4941-b644-e4a652920df7'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:19 devstack sudo[90518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:19 devstack sudo[90518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-8e486757-20e3-4151-beb4-4013aaba9788-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-8e486757-20e3-4151-beb4-4013aaba9788-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-quobyte-8e486757-20e3-4151-beb4-4013aaba9788" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-8e486757-20e3-4151-beb4-4013aaba9788" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15ee03f-e077-466c-8869-c65c1f5408fc]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:19 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788
Apr 13 17:14:19 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:19 devstack sudo[90518]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Deleted volume successfully.
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-ba7cf000-4753-45f2-a8c4-337998d22b51 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-515bad33-44e6-471f-af05-0ee329e17cad-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:19 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:19 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788
Apr 13 17:14:19 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:20 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-8e486757-20e3-4151-beb4-4013aaba9788" returned: 0 in 0.386s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-8e486757-20e3-4151-beb4-4013aaba9788" released by "delete_volume" :: held 0.878s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Created reservations ['62c1c5b1-0aa7-42ef-a7e6-429bd79c693b', '06449284-e2fb-4a3b-94c4-9eedf8eda34e', '5c25083f-ac92-4953-8d7a-d76861e83ed5', 'f507f985-8764-45f6-9215-f0276b62b36e'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:20 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:20 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-e7bf0615-f094-4acc-aec6-1234b5b86945-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-e7bf0615-f094-4acc-aec6-1234b5b86945-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "cinder-quobyte-e7bf0615-f094-4acc-aec6-1234b5b86945" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-e7bf0615-f094-4acc-aec6-1234b5b86945" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d9dc71-109f-4f6d-9390-2e2d0cfd673d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:20 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945
Apr 13 17:14:20 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:20 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:20 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Deleted volume successfully.
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-77023457-6bbb-4095-8e80-441214516094 tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-8e486757-20e3-4151-beb4-4013aaba9788-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:20 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945" returned: 0 in 0.458s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:20 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945
Apr 13 17:14:20 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:21 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e7bf0615-f094-4acc-aec6-1234b5b86945" returned: 0 in 0.382s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-quobyte-e7bf0615-f094-4acc-aec6-1234b5b86945" released by "delete_volume" :: held 0.862s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Created reservations ['e5c37f63-edf5-44c6-9d77-6a39b67fc8b5', '956c9889-b15f-4740-9d47-7b82c44acbd7', 'd30686f9-9344-48cc-8b4c-fa0c5d3ef89b', '710cdd50-3dd7-4c3d-96f0-2ca01d6da68c'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:21 devstack sudo[90543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:21 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:21 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Deleted volume successfully.
Apr 13 17:14:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bd47f39a-3a5b-4954-8b8c-046677cdc16f tempest-CreateVolumesFromImageTest-726788342 None] Lock "cinder-e7bf0615-f094-4acc-aec6-1234b5b86945-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (23497696-a230-448b-bcfa-3c99239f7922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d889dbb-7fa0-4fda-abe9-8b3cdc7a5334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d889dbb-7fa0-4fda-abe9-8b3cdc7a5334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517246420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bdedda-9429-441c-9055-48e039b1e807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:28Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a03df38-3455-48e8-88d8-e21ac531fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a03df38-3455-48e8-88d8-e21ac531fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafea4e5-9b27-4735-ab65-dbe15bd8836d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aafea4e5-9b27-4735-ab65-dbe15bd8836d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28bdedda-9429-441c-9055-48e039b1e807', 'volume_name': 'volume-28bdedda-9429-441c-9055-48e039b1e807', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0060ff84-798a-475c-afd7-8c2ad7cf026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0060ff84-798a-475c-afd7-8c2ad7cf026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f9e396-72cd-4add-ac71-7b48e372aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume 28bdedda-9429-441c-9055-48e039b1e807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28bdedda-9429-441c-9055-48e039b1e807', 'volume_size': 1}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517246420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bdedda-9429-441c-9055-48e039b1e807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:28Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Creating volume 28bdedda-9429-441c-9055-48e039b1e807 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:28 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:28 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807 1073741824
Apr 13 17:14:28 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (2f41fce1-3ff9-425b-86c5-9664c4f25d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56403a05-cba4-4d00-a0a2-3fc543c069b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56403a05-cba4-4d00-a0a2-3fc543c069b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1549663569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2188e1fa-eb62-4789-8976-119082441275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3615ed0e043b433a91e085682b691134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:28Z,use_quota=True,user_id='0daa84eac0fc4746b5bf153c62e0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d548e92c-e835-4367-8c6b-f0db0de5053e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d548e92c-e835-4367-8c6b-f0db0de5053e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab51e1d-3fe6-4174-95ca-87fa770f4b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab51e1d-3fe6-4174-95ca-87fa770f4b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2188e1fa-eb62-4789-8976-119082441275', 'volume_name': 'volume-2188e1fa-eb62-4789-8976-119082441275', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a987b41-a223-4a4e-ac37-5e6eb1ce9b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a987b41-a223-4a4e-ac37-5e6eb1ce9b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10968706-63e0-40e1-b763-2c70676a0301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Volume 2188e1fa-eb62-4789-8976-119082441275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2188e1fa-eb62-4789-8976-119082441275', 'volume_size': 1}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (13e87424-80ce-40fa-9061-fe1e4fc59d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760d1319-ff62-4bac-82a5-f05947908f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760d1319-ff62-4bac-82a5-f05947908f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-285566916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae247b4-f6a5-4699-804f-6bc5eea72850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b4926a-4ee0-4f03-9b44-342ab81e12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b4926a-4ee0-4f03-9b44-342ab81e12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c9f8e6-e61b-456a-bf6f-0c1084516840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7c9f8e6-e61b-456a-bf6f-0c1084516840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae247b4-f6a5-4699-804f-6bc5eea72850', 'volume_name': 'volume-4ae247b4-f6a5-4699-804f-6bc5eea72850', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc342d4-3077-4940-9836-4c0f4592fe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc342d4-3077-4940-9836-4c0f4592fe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036c2790-3be0-4997-8284-29b42389a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Volume 4ae247b4-f6a5-4699-804f-6bc5eea72850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae247b4-f6a5-4699-804f-6bc5eea72850', 'volume_size': 1}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (db8a344f-6a25-42eb-a139-cc6fd0bad73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76b637c-8952-4704-8da2-777a34add947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76b637c-8952-4704-8da2-777a34add947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1592741318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47acea7e-9968-4a93-b6ea-40a8c374b9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62358175-94e7-4942-9e6a-a8eac3cc4ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62358175-94e7-4942-9e6a-a8eac3cc4ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfd089f-b2da-49cc-adb6-34d979e46f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfd089f-b2da-49cc-adb6-34d979e46f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47acea7e-9968-4a93-b6ea-40a8c374b9fc', 'volume_name': 'volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a0010f-9f95-4679-85a5-0a3a050c4f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a0010f-9f95-4679-85a5-0a3a050c4f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f0fea4-b97d-4fa9-b71f-83c3902ee1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:28 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Volume 47acea7e-9968-4a93-b6ea-40a8c374b9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc', 'volume_size': 1}
Apr 13 17:14:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (c406b91d-e5ad-44e1-a990-874a49770c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbe8246-f2d3-498a-a898-5d50729905a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbe8246-f2d3-498a-a898-5d50729905a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023435592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a196a276-d589-4ce8-986c-a24e63c6cc12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5212cb99-b453-4496-99dd-f60761649136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5212cb99-b453-4496-99dd-f60761649136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13466d3c-3f5a-4470-8862-fff58c9f2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13466d3c-3f5a-4470-8862-fff58c9f2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a196a276-d589-4ce8-986c-a24e63c6cc12', 'volume_name': 'volume-a196a276-d589-4ce8-986c-a24e63c6cc12', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c58fcdb-1058-49a5-9fee-b3fc3ae0cb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c58fcdb-1058-49a5-9fee-b3fc3ae0cb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e06fc51-f82d-4b59-b3c0-366094d3c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Volume a196a276-d589-4ce8-986c-a24e63c6cc12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a196a276-d589-4ce8-986c-a24e63c6cc12', 'volume_size': 1}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807 1073741824" returned: 0 in 0.715s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:29 devstack sudo[90591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807
Apr 13 17:14:29 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (4f61fea4-3cc7-46d0-aadc-d5186f236f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454618a7-7d80-41d2-99ca-d715623cdcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454618a7-7d80-41d2-99ca-d715623cdcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1753152174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea232c0e-f389-42b2-92e1-e3aded863c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2cea7b-4e4b-4a5c-bca8-dac99ce562b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2cea7b-4e4b-4a5c-bca8-dac99ce562b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b616762-caaf-4c1e-8edc-85b1cfb37dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b616762-caaf-4c1e-8edc-85b1cfb37dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea232c0e-f389-42b2-92e1-e3aded863c0e', 'volume_name': 'volume-ea232c0e-f389-42b2-92e1-e3aded863c0e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71446417-7d05-4f96-92b0-bfd7c676fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71446417-7d05-4f96-92b0-bfd7c676fffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569e57e6-8a81-407d-b01a-226b3d025c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Volume ea232c0e-f389-42b2-92e1-e3aded863c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea232c0e-f389-42b2-92e1-e3aded863c0e', 'volume_size': 1}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (ebe619cf-4e2a-4480-8a4f-0f741f7c9c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f119d9-001c-40af-9a27-fe463367561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f119d9-001c-40af-9a27-fe463367561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-689116660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f02ea5f-fa74-4fe0-aeac-fa329aff9860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670e57c1-906a-41bb-b07d-69e6033ef023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670e57c1-906a-41bb-b07d-69e6033ef023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9de7a7f-66d4-4c41-9d58-f1b6e8723386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9de7a7f-66d4-4c41-9d58-f1b6e8723386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f02ea5f-fa74-4fe0-aeac-fa329aff9860', 'volume_name': 'volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4390ae23-1c72-4526-ac89-d941115476c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4390ae23-1c72-4526-ac89-d941115476c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4b0f80-bf5e-480c-8a48-861f9a7e6813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Volume 3f02ea5f-fa74-4fe0-aeac-fa329aff9860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860', 'volume_size': 1}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:29 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807" returned: 0 in 0.571s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.183s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1549663569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2188e1fa-eb62-4789-8976-119082441275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3615ed0e043b433a91e085682b691134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:28Z,use_quota=True,user_id='0daa84eac0fc4746b5bf153c62e0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Creating volume 2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:29 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:29 devstack sudo[90595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 1073741824
Apr 13 17:14:29 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f9e396-72cd-4add-ac71-7b48e372aefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28bdedda-9429-441c-9055-48e039b1e807', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4cb625-f476-4895-b510-17a73835a765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:29 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume volume-28bdedda-9429-441c-9055-48e039b1e807 (28bdedda-9429-441c-9055-48e039b1e807): created successfully
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4cb625-f476-4895-b510-17a73835a765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:29 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (23497696-a230-448b-bcfa-3c99239f7922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:29 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-af6f8960-0665-4ecc-85bc-1782db8987e3 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created volume successfully.
Apr 13 17:14:30 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 1073741824" returned: 0 in 0.533s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:30 devstack sudo[90600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275
Apr 13 17:14:30 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:31 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-285566916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae247b4-f6a5-4699-804f-6bc5eea72850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Creating volume 4ae247b4-f6a5-4699-804f-6bc5eea72850 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:31 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:31 devstack sudo[90603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850 1073741824
Apr 13 17:14:31 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:31 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850 1073741824" returned: 0 in 0.550s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10968706-63e0-40e1-b763-2c70676a0301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2188e1fa-eb62-4789-8976-119082441275', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d865f448-5ed8-4d77-8dcf-eee96d47f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:31 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Volume volume-2188e1fa-eb62-4789-8976-119082441275 (2188e1fa-eb62-4789-8976-119082441275): created successfully
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d865f448-5ed8-4d77-8dcf-eee96d47f89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:31 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (2f41fce1-3ff9-425b-86c5-9664c4f25d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:32 devstack sudo[90608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850
Apr 13 17:14:32 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:32 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8fbb2002-087c-46b7-970c-5858ef8f8068 tempest-VolumeDependencyTests-1409334899 None] Created volume successfully.
Apr 13 17:14:32 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.737s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1592741318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47acea7e-9968-4a93-b6ea-40a8c374b9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Creating volume 47acea7e-9968-4a93-b6ea-40a8c374b9fc {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:32 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:32 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:32 devstack sudo[90611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc 1073741824
Apr 13 17:14:32 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:33 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc 1073741824" returned: 0 in 0.539s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (036c2790-3be0-4997-8284-29b42389a536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae247b4-f6a5-4699-804f-6bc5eea72850', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff1a426-c19a-47cf-97ee-9f3ba26d93c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Volume volume-4ae247b4-f6a5-4699-804f-6bc5eea72850 (4ae247b4-f6a5-4699-804f-6bc5eea72850): created successfully
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff1a426-c19a-47cf-97ee-9f3ba26d93c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (13e87424-80ce-40fa-9061-fe1e4fc59d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:33 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc
Apr 13 17:14:33 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:33 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1859d703-8fde-4e29-b4af-5ddc6c5a7034 tempest-CreateVolumesFromImageTest-1822463471 None] Created volume successfully.
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (f88fbbe3-c032-4738-9639-9b2bc86fd188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb5c380-66ba-4b03-81b1-a204bc266028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb5c380-66ba-4b03-81b1-a204bc266028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392054845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:33Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7d9457-a72e-4acf-8fae-ea843ccecfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7d9457-a72e-4acf-8fae-ea843ccecfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb6c73d-e813-4df4-8a89-f40292433c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb6c73d-e813-4df4-8a89-f40292433c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225', 'volume_name': 'volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c62d80-8c1d-433c-94b4-869f9f4becb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c62d80-8c1d-433c-94b4-869f9f4becb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784c42ac-2dbd-4c3f-bb4b-1fbdd90195e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:33 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225', 'volume_size': 1}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:33 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (72b011db-9c06-4922-91e7-50bd17aac346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114e58f8-9bcf-4d68-ac40-a983679e2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114e58f8-9bcf-4d68-ac40-a983679e2330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174541651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccecc796-97b7-42d3-8afd-f77c74db1452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:34Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3af21e-5e05-4225-9b47-031b85b4646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3af21e-5e05-4225-9b47-031b85b4646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f2515b-0191-43f6-b1ca-f3ed7957cad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f2515b-0191-43f6-b1ca-f3ed7957cad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccecc796-97b7-42d3-8afd-f77c74db1452', 'volume_name': 'volume-ccecc796-97b7-42d3-8afd-f77c74db1452', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b897d83-22ba-4781-9eb5-022504e47afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b897d83-22ba-4781-9eb5-022504e47afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52e2076-f8f5-44d2-9bd6-e9382bff3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume ccecc796-97b7-42d3-8afd-f77c74db1452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccecc796-97b7-42d3-8afd-f77c74db1452', 'volume_size': 1}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (9a74f111-defe-4b7b-9403-5e7d3a578164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d750e819-0a5c-43a3-bf85-92f5804689f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d750e819-0a5c-43a3-bf85-92f5804689f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497300489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b489c2-faab-4cbd-a047-6b02beeefd21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:34Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa25e545-1920-400c-9908-75d7fc2cfd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa25e545-1920-400c-9908-75d7fc2cfd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfcd11b-01eb-4754-81c0-9da43cbe9163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfcd11b-01eb-4754-81c0-9da43cbe9163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b489c2-faab-4cbd-a047-6b02beeefd21', 'volume_name': 'volume-48b489c2-faab-4cbd-a047-6b02beeefd21', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3bb3f7-4555-460f-93cd-fd92eea1661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3bb3f7-4555-460f-93cd-fd92eea1661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4408d-2d16-4a04-af97-76a452b8dbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume 48b489c2-faab-4cbd-a047-6b02beeefd21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b489c2-faab-4cbd-a047-6b02beeefd21', 'volume_size': 1}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:34 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc" returned: 0 in 0.745s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.422s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023435592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a196a276-d589-4ce8-986c-a24e63c6cc12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Creating volume a196a276-d589-4ce8-986c-a24e63c6cc12 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:34 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:34 devstack sudo[90621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12 1073741824
Apr 13 17:14:34 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2f0fea4-b97d-4fa9-b71f-83c3902ee1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af884912-6cca-4ccf-91d9-2836602cc954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (aabc6b67-c7f4-4c78-946d-16ac5ed489c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cd4960-6745-411b-9e3d-856530063ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Volume volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc (47acea7e-9968-4a93-b6ea-40a8c374b9fc): created successfully
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af884912-6cca-4ccf-91d9-2836602cc954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (db8a344f-6a25-42eb-a139-cc6fd0bad73a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1cd4960-6745-411b-9e3d-856530063ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984547373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2affb054-59eb-4078-b8c1-d749aefa2ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:34Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594a0bfe-f664-4904-b14b-63a853c8fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594a0bfe-f664-4904-b14b-63a853c8fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30aa2ece-528d-4d69-b0e5-90b0050c9b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30aa2ece-528d-4d69-b0e5-90b0050c9b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2affb054-59eb-4078-b8c1-d749aefa2ebe', 'volume_name': 'volume-2affb054-59eb-4078-b8c1-d749aefa2ebe', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c2ee7c-d61b-4f78-9128-740d78567119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c2ee7c-d61b-4f78-9128-740d78567119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7d8f2c-14ad-4dcc-b7ca-df9b01d9560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume 2affb054-59eb-4078-b8c1-d749aefa2ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2affb054-59eb-4078-b8c1-d749aefa2ebe', 'volume_size': 1}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:34 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3bc3c3b5-aed4-4ab5-a583-891cf35a8f17 tempest-CreateVolumesFromImageTest-1822463471 None] Created volume successfully.
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (09c8eb1b-2e63-4f7f-8643-5fd7bb4209fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193e46ac-fba0-4d7a-847f-7bbe10d3715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193e46ac-fba0-4d7a-847f-7bbe10d3715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310694757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422083a0-8901-4a32-a16d-a7acc88b5e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:35Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a91dfbc-7752-48b7-b0b7-76d2b12fd05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a91dfbc-7752-48b7-b0b7-76d2b12fd05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8feb17ba-cf94-406d-bc59-0d7a7185be88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8feb17ba-cf94-406d-bc59-0d7a7185be88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422083a0-8901-4a32-a16d-a7acc88b5e9b', 'volume_name': 'volume-422083a0-8901-4a32-a16d-a7acc88b5e9b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de66493-56de-40d8-8e82-df82809101a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de66493-56de-40d8-8e82-df82809101a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d8c650-dcda-497a-8fbb-99425b3b8038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:34 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume 422083a0-8901-4a32-a16d-a7acc88b5e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422083a0-8901-4a32-a16d-a7acc88b5e9b', 'volume_size': 1}
Apr 13 17:14:34 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:35 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:35 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12 1073741824" returned: 0 in 0.698s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:36 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:36 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12
Apr 13 17:14:36 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:37 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12" returned: 0 in 0.463s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] <== create_volume: return (2873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.876s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.087s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1753152174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea232c0e-f389-42b2-92e1-e3aded863c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Creating volume ea232c0e-f389-42b2-92e1-e3aded863c0e {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:37 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:37 devstack sudo[90629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e 1073741824
Apr 13 17:14:37 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:37 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:37 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e 1073741824" returned: 0 in 0.503s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e06fc51-f82d-4b59-b3c0-366094d3c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a196a276-d589-4ce8-986c-a24e63c6cc12', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f24b780-79e6-49f8-a517-9c3653a46546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:38 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Volume volume-a196a276-d589-4ce8-986c-a24e63c6cc12 (a196a276-d589-4ce8-986c-a24e63c6cc12): created successfully
Apr 13 17:14:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f24b780-79e6-49f8-a517-9c3653a46546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:38 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (c406b91d-e5ad-44e1-a990-874a49770c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:38 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:38 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-149a164c-29e5-47e8-ba0f-a3bb724a2a06 tempest-CreateVolumesFromImageTest-1822463471 None] Created volume successfully.
Apr 13 17:14:38 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e
Apr 13 17:14:38 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:39 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e" returned: 0 in 0.539s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.531s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-689116660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f02ea5f-fa74-4fe0-aeac-fa329aff9860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a838217164b145b7b01076bfce739e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:29Z,use_quota=True,user_id='459885f377c44db1afb692f46448d9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Creating volume 3f02ea5f-fa74-4fe0-aeac-fa329aff9860 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:39 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569e57e6-8a81-407d-b01a-226b3d025c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea232c0e-f389-42b2-92e1-e3aded863c0e', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012c998b-55da-4e94-ae8a-60ce7a40b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:39 devstack sudo[90637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860 1073741824
Apr 13 17:14:39 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:39 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Volume volume-ea232c0e-f389-42b2-92e1-e3aded863c0e (ea232c0e-f389-42b2-92e1-e3aded863c0e): created successfully
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012c998b-55da-4e94-ae8a-60ce7a40b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (4f61fea4-3cc7-46d0-aadc-d5186f236f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:39 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ccafbb00-aed6-422b-91e0-0c1dcf606715 tempest-CreateVolumesFromImageTest-1822463471 None] Created volume successfully.
Apr 13 17:14:39 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860 1073741824" returned: 0 in 0.554s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:39 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:39 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860
Apr 13 17:14:39 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:40 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860" returned: 0 in 0.454s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.230s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392054845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:33Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Creating volume aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:40 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4b0f80-bf5e-480c-8a48-861f9a7e6813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:40 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 1073741824
Apr 13 17:14:40 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444dc477-750c-4c04-a05f-073a4ec4d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:40 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Volume volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860 (3f02ea5f-fa74-4fe0-aeac-fa329aff9860): created successfully
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (444dc477-750c-4c04-a05f-073a4ec4d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Flow 'volume_create_manager' (ebe619cf-4e2a-4480-8a4f-0f741f7c9c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:40 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c991d647-d0a3-4f01-b392-818cc71cd6ae tempest-CreateVolumesFromImageTest-1822463471 None] Created volume successfully.
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-3f02ea5f-fa74-4fe0-aeac-fa329aff9860-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-3f02ea5f-fa74-4fe0-aeac-fa329aff9860-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-quobyte-3f02ea5f-fa74-4fe0-aeac-fa329aff9860" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-3f02ea5f-fa74-4fe0-aeac-fa329aff9860" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ccc69-6e3a-43bb-84f2-e03e5d9c8740]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:40 devstack sudo[90651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860
Apr 13 17:14:40 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:40 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 1073741824" returned: 0 in 0.557s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:40 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:40 devstack sudo[90653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225
Apr 13 17:14:40 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:41 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:41 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860
Apr 13 17:14:41 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:41 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.276s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784c42ac-2dbd-4c3f-bb4b-1fbdd90195e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7543dd3-6a6e-49d7-8d63-1da6a4598384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Creating offline snapshot ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c of volume 2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:14:41 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 (aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225): created successfully
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7543dd3-6a6e-49d7-8d63-1da6a4598384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (f88fbbe3-c032-4738-9639-9b2bc86fd188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e297723-92d8-4230-9e00-97e54d99322c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:41 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-792abdf5-99d0-43d6-b80a-d3ba1cf4a0eb tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created volume successfully.
Apr 13 17:14:41 devstack sudo[90661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275
Apr 13 17:14:41 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:41 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-3f02ea5f-fa74-4fe0-aeac-fa329aff9860" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-3f02ea5f-fa74-4fe0-aeac-fa329aff9860" released by "delete_volume" :: held 0.982s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Created reservations ['4af9b996-cd98-407e-bae7-ef80d6004a2c', '0845cf19-1b6e-43e3-80b6-b7506f02ce7a', 'e2cbc55c-ab84-4891-a6b2-cf9aafee3561', '5fb4deae-10d2-44c7-9f8b-720201ecea70'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:41 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:41 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-ea232c0e-f389-42b2-92e1-e3aded863c0e-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-ea232c0e-f389-42b2-92e1-e3aded863c0e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-quobyte-ea232c0e-f389-42b2-92e1-e3aded863c0e" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-ea232c0e-f389-42b2-92e1-e3aded863c0e" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[70116847-6f12-4842-8f1c-1b2e355274ac]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:41 devstack sudo[90666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e
Apr 13 17:14:41 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:41 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275" returned: 0 in 0.607s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:41 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:41 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c 1G
Apr 13 17:14:41 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:42 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:42 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Deleted volume successfully.
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1214974a-8a0f-4e4e-9bd3-39653ed4fd03 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-3f02ea5f-fa74-4fe0-aeac-fa329aff9860-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:42 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e" returned: 0 in 0.621s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:42 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e
Apr 13 17:14:42 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:42 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c 1G" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2188e1fa-eb62-4789-8976-119082441275 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:42 devstack sudo[90682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2188e1fa-eb62-4789-8976-119082441275 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c
Apr 13 17:14:42 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:42 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ea232c0e-f389-42b2-92e1-e3aded863c0e" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-ea232c0e-f389-42b2-92e1-e3aded863c0e" released by "delete_volume" :: held 1.183s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Created reservations ['4bca3f26-de3e-4d1a-93f3-f66303018219', '6215ffc5-ba2d-428a-bcae-4aba5d26d937', 'b7f7baed-eb52-4c12-8b6b-af95db2ffc0c', 'bdc1e836-f5b2-4cce-a2c0-e15a7a790583'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:42 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2188e1fa-eb62-4789-8976-119082441275 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" returned: 0 in 0.577s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:42 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c is being set with open permissions: ugo+rw
Apr 13 17:14:42 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:42 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:42 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:43 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c
Apr 13 17:14:43 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:43 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.425s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:43 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Deleted volume successfully.
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d8887512-e54d-4000-b159-5ffa4f26d8a3 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-ea232c0e-f389-42b2-92e1-e3aded863c0e-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:43 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:43 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.info
Apr 13 17:14:43 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-a196a276-d589-4ce8-986c-a24e63c6cc12-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-a196a276-d589-4ce8-986c-a24e63c6cc12-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-quobyte-a196a276-d589-4ce8-986c-a24e63c6cc12" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-a196a276-d589-4ce8-986c-a24e63c6cc12" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ad0e5-6b2a-45d9-8fc8-effc90525d6a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:43 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:44 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.info" returned: 0 in 0.500s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:44 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.info is being set with open permissions: ugo+rw
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:44 devstack sudo[90698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.info
Apr 13 17:14:44 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:44 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12
Apr 13 17:14:44 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:44 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.info" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.228s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.302s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174541651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccecc796-97b7-42d3-8afd-f77c74db1452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:34Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Creating volume ccecc796-97b7-42d3-8afd-f77c74db1452 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:44 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:44 devstack sudo[90702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452 1073741824
Apr 13 17:14:44 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:44 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-3d64235f-d72e-446e-a1b2-dfa79dca4d2f tempest-VolumeDependencyTests-1409334899 None] Create snapshot completed successfully
Apr 13 17:14:44 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12" returned: 0 in 0.708s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:44 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:44 devstack sudo[90707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12
Apr 13 17:14:44 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:45 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452 1073741824" returned: 0 in 0.622s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:45 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452
Apr 13 17:14:45 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:45 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a196a276-d589-4ce8-986c-a24e63c6cc12" returned: 0 in 0.688s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-a196a276-d589-4ce8-986c-a24e63c6cc12" released by "delete_volume" :: held 1.419s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Created reservations ['ceb9fbbd-985b-4051-b20f-92084aa5b025', 'b1aa4473-4574-405e-bdf7-75ed8b739182', '9b6819ea-f868-45f6-96b3-18e939d6fe02', '26332ef7-5f56-40c9-b252-a274da9ea02f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:45 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:45 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:45 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452" returned: 0 in 0.537s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.246s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1497300489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b489c2-faab-4cbd-a047-6b02beeefd21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:34Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Creating volume 48b489c2-faab-4cbd-a047-6b02beeefd21 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:45 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52e2076-f8f5-44d2-9bd6-e9382bff3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccecc796-97b7-42d3-8afd-f77c74db1452', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9074ad88-ec9f-4d8e-bbb4-790a8ed2d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:45 devstack sudo[90718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21 1073741824
Apr 13 17:14:45 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume volume-ccecc796-97b7-42d3-8afd-f77c74db1452 (ccecc796-97b7-42d3-8afd-f77c74db1452): created successfully
Apr 13 17:14:45 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9074ad88-ec9f-4d8e-bbb4-790a8ed2d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (72b011db-9c06-4922-91e7-50bd17aac346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:45 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-9aaa76a8-2705-4f62-a1e1-d48bacf3eebc tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created volume successfully.
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (d1950d60-e433-4386-94cc-5c5b600e7e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38a8e5e-0df2-41d9-b875-4c6cc489ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38a8e5e-0df2-41d9-b875-4c6cc489ac72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-137890125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61aa6e9d-dddb-47b3-b41e-30c195d5d9dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3615ed0e043b433a91e085682b691134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:46Z,use_quota=True,user_id='0daa84eac0fc4746b5bf153c62e0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c224a3-1b02-49c3-b1ca-593b3205626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c224a3-1b02-49c3-b1ca-593b3205626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ace581f-7503-4048-a71d-6da59bb4ef09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ace581f-7503-4048-a71d-6da59bb4ef09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61aa6e9d-dddb-47b3-b41e-30c195d5d9dd', 'volume_name': 'volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd', 'volume_size': 1, 'snapshot_id': 'ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:45 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c22ded-3365-4707-8e6a-83413aeaf9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c22ded-3365-4707-8e6a-83413aeaf9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cdf1d7-24f3-42fa-bb1e-913281ea3a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Volume 61aa6e9d-dddb-47b3-b41e-30c195d5d9dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd', 'volume_size': 1, 'snapshot_id': 'ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c'}
Apr 13 17:14:46 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.531s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Deleted volume successfully.
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bf99626e-41fd-42c2-a6b8-75656411682b tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-a196a276-d589-4ce8-986c-a24e63c6cc12-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-47acea7e-9968-4a93-b6ea-40a8c374b9fc-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-47acea7e-9968-4a93-b6ea-40a8c374b9fc-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-quobyte-47acea7e-9968-4a93-b6ea-40a8c374b9fc" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-47acea7e-9968-4a93-b6ea-40a8c374b9fc" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef0a0a8-2108-42c9-ae7b-98c84752ebc5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:46 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc
Apr 13 17:14:46 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Flow 'volume_create_manager' (a885d0b1-6b7a-4f11-b74d-6ed4b4c7eb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b04022-0d35-4d27-8b6b-b965aea45f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b04022-0d35-4d27-8b6b-b965aea45f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-125351397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1136fe-4209-4fd4-ac92-4cfcab248ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da79a46c7e0949a9a0a20959574643ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:46Z,use_quota=True,user_id='ca774d0d102944df83a128ff4a1ade07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2cd32e-ecef-4a08-b343-80fedf943fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2cd32e-ecef-4a08-b343-80fedf943fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8650ae-d0a6-4681-a16c-d831b22bc10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8650ae-d0a6-4681-a16c-d831b22bc10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1136fe-4209-4fd4-ac92-4cfcab248ad1', 'volume_name': 'volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c4275e-f9ba-4d2b-808c-b7e5d54a68c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85c4275e-f9ba-4d2b-808c-b7e5d54a68c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:46 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a16c9c-6f37-4a5e-9177-09018e0709c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Volume df1136fe-4209-4fd4-ac92-4cfcab248ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1', 'volume_size': 1}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21 1073741824" returned: 0 in 0.660s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:46 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21
Apr 13 17:14:46 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:46 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:46 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc
Apr 13 17:14:46 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:46 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21" returned: 0 in 0.414s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.107s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-984547373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2affb054-59eb-4078-b8c1-d749aefa2ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:34Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Creating volume 2affb054-59eb-4078-b8c1-d749aefa2ebe {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:46 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4408d-2d16-4a04-af97-76a452b8dbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b489c2-faab-4cbd-a047-6b02beeefd21', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:46 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe 1073741824
Apr 13 17:14:46 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd531378-25c9-4d5b-be38-d00add411ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:46 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume volume-48b489c2-faab-4cbd-a047-6b02beeefd21 (48b489c2-faab-4cbd-a047-6b02beeefd21): created successfully
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd531378-25c9-4d5b-be38-d00add411ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:46 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (9a74f111-defe-4b7b-9403-5e7d3a578164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:46 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f4015df4-0592-4adb-af79-35f66c682927 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created volume successfully.
Apr 13 17:14:47 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-47acea7e-9968-4a93-b6ea-40a8c374b9fc" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-47acea7e-9968-4a93-b6ea-40a8c374b9fc" released by "delete_volume" :: held 0.950s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Created reservations ['68534967-5eea-4c3c-8e20-04e014c40678', 'edbea246-13e5-43c6-a003-dc01968d0e60', '673789a7-5a2c-42f1-ac50-e9158cc79700', '24766b6f-f240-4eab-b71d-3b40815c3523'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-4ae247b4-f6a5-4699-804f-6bc5eea72850-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:47 devstack sudo[90740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:47 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-4ae247b4-f6a5-4699-804f-6bc5eea72850-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "cinder-quobyte-4ae247b4-f6a5-4699-804f-6bc5eea72850" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-4ae247b4-f6a5-4699-804f-6bc5eea72850" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f1175-660e-4a13-8d7d-c80746b0b927]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:47 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe 1073741824" returned: 0 in 0.543s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:47 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe
Apr 13 17:14:47 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:47 devstack sudo[90742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850
Apr 13 17:14:47 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:47 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.461s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Deleted volume successfully.
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-366a7298-33fc-4223-a3eb-7773ed4e8990 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-47acea7e-9968-4a93-b6ea-40a8c374b9fc-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:47 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe" returned: 0 in 0.424s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.917s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1310694757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422083a0-8901-4a32-a16d-a7acc88b5e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a772443f7de843f297b20455fe29e52c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:35Z,use_quota=True,user_id='142def6a6ad8453283f316accbcc26dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Creating volume 422083a0-8901-4a32-a16d-a7acc88b5e9b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:47 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:47 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7d8f2c-14ad-4dcc-b7ca-df9b01d9560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2affb054-59eb-4078-b8c1-d749aefa2ebe', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9075d16-edd5-4f04-afd4-88a06fdbe322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:47 devstack sudo[90751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b 1073741824
Apr 13 17:14:47 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:47 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume volume-2affb054-59eb-4078-b8c1-d749aefa2ebe (2affb054-59eb-4078-b8c1-d749aefa2ebe): created successfully
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9075d16-edd5-4f04-afd4-88a06fdbe322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:47 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (aabc6b67-c7f4-4c78-946d-16ac5ed489c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:47 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850
Apr 13 17:14:47 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:47 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-a2ba0bf4-d94b-464b-9b49-885b2b5c8226 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created volume successfully.
Apr 13 17:14:48 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-4ae247b4-f6a5-4699-804f-6bc5eea72850" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-quobyte-4ae247b4-f6a5-4699-804f-6bc5eea72850" released by "delete_volume" :: held 0.955s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Created reservations ['b75178e7-2dcf-4a4a-af3c-088d6d032d4a', '3775d8ed-36cb-4c9e-9874-6b7ec28cd668', 'a2d228b4-f51f-487e-bc0b-a3121533d1f3', '51f20bf0-8912-4150-8ddd-fffd74fa07a0'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:48 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b 1073741824" returned: 0 in 0.514s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:48 devstack sudo[90759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:48 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:48 devstack sudo[90761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:48 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:48 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b" returned: 0 in 0.478s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.738s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d8c650-dcda-497a-8fbb-99425b3b8038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422083a0-8901-4a32-a16d-a7acc88b5e9b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313fe296-39c9-465e-a798-55abc9297049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:48 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Volume volume-422083a0-8901-4a32-a16d-a7acc88b5e9b (422083a0-8901-4a32-a16d-a7acc88b5e9b): created successfully
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313fe296-39c9-465e-a798-55abc9297049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Flow 'volume_create_manager' (09c8eb1b-2e63-4f7f-8643-5fd7bb4209fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Creating volume 61aa6e9d-dddb-47b3-b41e-30c195d5d9dd from snapshot ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d5bfc0ff-fcb3-4dea-8fd5-50ae5fe48849 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created volume successfully.
Apr 13 17:14:48 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] snapshot: ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c, volume: 61aa6e9d-dddb-47b3-b41e-30c195d5d9dd,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.573s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:48 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Deleted volume successfully.
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[26edd5f7-4645-4624-81a8-737a617d8c93]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:48 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-76d62322-3913-4f58-9227-76c93c2ded64 tempest-CreateVolumesFromImageTest-1822463471 None] Lock "cinder-4ae247b4-f6a5-4699-804f-6bc5eea72850-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:48 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c
Apr 13 17:14:48 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:49 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" returned: 0 in 0.527s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2188e1fa-eb62-4789-8976-119082441275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bb2495-d141-4591-a2e5-b8d8b5d551e7]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:49 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275
Apr 13 17:14:49 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-422083a0-8901-4a32-a16d-a7acc88b5e9b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-422083a0-8901-4a32-a16d-a7acc88b5e9b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-quobyte-422083a0-8901-4a32-a16d-a7acc88b5e9b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-422083a0-8901-4a32-a16d-a7acc88b5e9b" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42b4e6f-5789-45b5-a3cf-3dbec648354c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:49 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:49 devstack sudo[90775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b
Apr 13 17:14:49 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:50 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275" returned: 0 in 0.609s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:50 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd
Apr 13 17:14:50 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (32daa938-f0b3-457e-9485-a837a910b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d20a64e-ff7d-475e-a168-6b663aa3e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d20a64e-ff7d-475e-a168-6b663aa3e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616763012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a253f8-284d-4d28-a90b-78f76c97f443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:50Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79c00c6-2fa1-489f-a027-431163dd32f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79c00c6-2fa1-489f-a027-431163dd32f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d85a65-e3e7-4d0d-a3d6-007194c7c9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d85a65-e3e7-4d0d-a3d6-007194c7c9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a253f8-284d-4d28-a90b-78f76c97f443', 'volume_name': 'volume-22a253f8-284d-4d28-a90b-78f76c97f443', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae349d93-2d85-48cf-b45a-ecd3907f634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae349d93-2d85-48cf-b45a-ecd3907f634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f2c89b-bee5-4f09-bbd4-14bfaa67281d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:50 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume 22a253f8-284d-4d28-a90b-78f76c97f443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a253f8-284d-4d28-a90b-78f76c97f443', 'volume_size': 1}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:50 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:50 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:50 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b
Apr 13 17:14:50 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:51 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:51 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-422083a0-8901-4a32-a16d-a7acc88b5e9b" returned: 0 in 1.406s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:51 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-422083a0-8901-4a32-a16d-a7acc88b5e9b" released by "delete_volume" :: held 1.945s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:51 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created reservations ['493e039c-92b3-4ca4-ab3e-45e04692f4a3', 'ad9928d9-f35c-4f47-8d8b-91750c342491', '98f15c53-7bfb-4f25-b017-a92a912454d1', 'fee44b03-65d1-454e-99d0-99f1988f716a'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:52 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:52 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:52 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" returned: 0 in 2.030s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a534904-a09b-4a50-8bd9-0b23790a0bdf]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-2affb054-59eb-4078-b8c1-d749aefa2ebe-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-2affb054-59eb-4078-b8c1-d749aefa2ebe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:52 devstack sudo[90806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275
Apr 13 17:14:52 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-quobyte-2affb054-59eb-4078-b8c1-d749aefa2ebe" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-2affb054-59eb-4078-b8c1-d749aefa2ebe" acquired by "delete_volume" :: waited 0.017s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6d0a36-7714-47bc-a421-d154fd7857d8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:52 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe
Apr 13 17:14:52 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:52 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:52 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Deleted volume successfully.
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d0bffb2a-8757-449d-8353-cc1f7e562284 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-422083a0-8901-4a32-a16d-a7acc88b5e9b-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:52 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275" returned: 0 in 0.659s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:14:52 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Converted 1024.00 MB image at 503.94 MB/s
Apr 13 17:14:52 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd is being set with open permissions: ugo+rw
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:52 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe" returned: 0 in 0.519s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:52 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:52 devstack sudo[90817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd
Apr 13 17:14:52 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:52 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe
Apr 13 17:14:52 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:53 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2affb054-59eb-4078-b8c1-d749aefa2ebe" returned: 0 in 0.389s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-2affb054-59eb-4078-b8c1-d749aefa2ebe" released by "delete_volume" :: held 0.935s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:53 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" returned: 0 in 0.423s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" released by "_copy_volume_from_snapshot" :: held 4.357s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" released by "_create_volume_from_snapshot" :: held 4.379s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.412s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.892s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-125351397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1136fe-4209-4fd4-ac92-4cfcab248ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da79a46c7e0949a9a0a20959574643ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:46Z,use_quota=True,user_id='ca774d0d102944df83a128ff4a1ade07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Creating volume df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:53 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:53 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 1073741824
Apr 13 17:14:53 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created reservations ['f62ed32b-82a5-4e1e-8886-d1b5af68eeab', '779bad9d-3d6f-470d-8cc9-c20478b9c417', '9c25b2b5-400c-4a7f-97dd-963a25e0e644', 'c6d9789c-87e8-4c28-99ed-8a63388381b3'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61cdf1d7-24f3-42fa-bb1e-913281ea3a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd', 'volume_size': 1, 'snapshot_id': 'ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ff3bc2-ac19-4d15-be12-558190aba641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:53 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Volume volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd (61aa6e9d-dddb-47b3-b41e-30c195d5d9dd): created successfully
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ff3bc2-ac19-4d15-be12-558190aba641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (d1950d60-e433-4386-94cc-5c5b600e7e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-2979149c-5f6b-470e-85a4-812c43a9c5ad tempest-VolumeDependencyTests-1409334899 None] Created volume successfully.
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:53 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:53 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-2188e1fa-eb62-4789-8976-119082441275" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-2188e1fa-eb62-4789-8976-119082441275" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Deleting offline snapshot ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c of volume 2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] snapshot_file for this snap is: volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d089d2b5-653a-4fd6-9f89-75287abba2aa]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:53 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c
Apr 13 17:14:53 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:53 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 1073741824" returned: 0 in 0.493s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:53 devstack sudo[90833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1
Apr 13 17:14:53 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:53 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:53 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Deleted volume successfully.
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-6ced59a9-f713-4fba-a137-72f497156998 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-2affb054-59eb-4078-b8c1-d749aefa2ebe-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:53 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" returned: 0 in 0.483s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2188e1fa-eb62-4789-8976-119082441275(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3753e68-f69b-4cfe-b312-9f63b8727d63]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:53 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:54 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275
Apr 13 17:14:54 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:54 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.998s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-616763012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a253f8-284d-4d28-a90b-78f76c97f443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:50Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Creating volume 22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:14:54 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a16c9c-6f37-4a5e-9177-09018e0709c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681f2d2e-2268-418a-89aa-c24cb8209fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:54 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 1073741824
Apr 13 17:14:54 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:54 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Volume volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 (df1136fe-4209-4fd4-ac92-4cfcab248ad1): created successfully
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681f2d2e-2268-418a-89aa-c24cb8209fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Flow 'volume_create_manager' (a885d0b1-6b7a-4f11-b74d-6ed4b4c7eb1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:54 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0685cbb5-528c-483b-9027-ee9081f928ac tempest-SnapshotDependencyTests-1289646662 None] Created volume successfully.
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-48b489c2-faab-4cbd-a047-6b02beeefd21-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-48b489c2-faab-4cbd-a047-6b02beeefd21-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-quobyte-48b489c2-faab-4cbd-a047-6b02beeefd21" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-48b489c2-faab-4cbd-a047-6b02beeefd21" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb11c0b1-e932-47a5-a94a-00185d313fa4]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:54 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275" returned: 0 in 0.512s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:54 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21
Apr 13 17:14:54 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:54 devstack sudo[90848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c
Apr 13 17:14:54 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:54 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 1073741824" returned: 0 in 0.505s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:54 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443
Apr 13 17:14:54 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:54 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21" returned: 0 in 0.516s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:54 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21
Apr 13 17:14:54 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:54 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" returned: 0 in 0.494s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:54 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:54 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c
Apr 13 17:14:54 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:55 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443" returned: 0 in 0.492s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.062s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Creating offline snapshot 514aa635-ffaf-4908-9389-364f1ac1bef6 of volume df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f2c89b-bee5-4f09-bbd4-14bfaa67281d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a253f8-284d-4d28-a90b-78f76c97f443', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb3f8fb-81be-40d0-a0b5-9222982b2d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc55462-36a8-49c6-8998-5efbb0af023e]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:55 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume volume-22a253f8-284d-4d28-a90b-78f76c97f443 (22a253f8-284d-4d28-a90b-78f76c97f443): created successfully
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb3f8fb-81be-40d0-a0b5-9222982b2d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (32daa938-f0b3-457e-9485-a837a910b92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-042ee62d-a7c6-4c38-a8b6-2009ac45b4c2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created volume successfully.
Apr 13 17:14:55 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1
Apr 13 17:14:55 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:55 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-48b489c2-faab-4cbd-a047-6b02beeefd21" returned: 0 in 0.419s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-48b489c2-faab-4cbd-a047-6b02beeefd21" released by "delete_volume" :: held 0.971s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created reservations ['4dfbebb3-76a6-473e-bf3e-3bb2f7005b13', '65fd5375-2d33-4ea7-8492-c0fe73490184', 'b35cb8eb-dee4-4ee4-b5dc-69d79a26c455', 'ae156d93-d45a-4ae8-9fa0-8e472156a8cd'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:55 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275.ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:55 devstack sudo[90870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:55 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c" released by "_delete_snapshot" :: held 2.017s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-2188e1fa-eb62-4789-8976-119082441275" released by "delete_snapshot" :: held 2.031s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-ccecc796-97b7-42d3-8afd-f77c74db1452-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-ccecc796-97b7-42d3-8afd-f77c74db1452-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-quobyte-ccecc796-97b7-42d3-8afd-f77c74db1452" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-ccecc796-97b7-42d3-8afd-f77c74db1452" acquired by "delete_volume" :: waited 0.018s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6083aa6-673f-4c60-80e9-2c75ff8a469a]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Created reservations ['210a5de6-0f61-456d-8302-ef6a8f4223a3', '07a63e12-29f6-4aed-855e-114fecc883d0', '943a297b-de4a-4c27-8a59-8d9e902caa06', 'fc27ec41-b940-4310-b3d5-bda7367a20cc'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Delete snapshot completed successfully.
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-0ddffeb7-7296-47d8-a8e4-e0bd7d0ec30f tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-ab0dab3a-3ff2-47f9-96ad-e79d957e4d0c-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:55 devstack sudo[90872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452
Apr 13 17:14:55 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:55 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:55 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1" returned: 0 in 0.638s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.436s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:55 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 1G
Apr 13 17:14:55 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:55 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Deleted volume successfully.
Apr 13 17:14:55 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-50432c0c-df16-4b15-a8bb-3e972ebddc7d tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-48b489c2-faab-4cbd-a047-6b02beeefd21-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:56 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452" returned: 0 in 0.565s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:56 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452
Apr 13 17:14:56 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:56 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 1G" returned: 0 in 0.482s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:56 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6
Apr 13 17:14:56 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:56 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-ccecc796-97b7-42d3-8afd-f77c74db1452" returned: 0 in 0.402s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-ccecc796-97b7-42d3-8afd-f77c74db1452" released by "delete_volume" :: held 1.004s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created reservations ['eecbefeb-4710-402b-a8fc-6ccd76bc9b10', 'c35b0071-0eae-4fc7-a783-cb5e799a883d', '3eb044b4-7816-4049-8b44-85b14ae1b928', '453f50ff-3a9f-473a-8da2-3ea6442a1837'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-2188e1fa-eb62-4789-8976-119082441275-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-2188e1fa-eb62-4789-8976-119082441275-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-2188e1fa-eb62-4789-8976-119082441275" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-2188e1fa-eb62-4789-8976-119082441275" acquired by "delete_volume" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e55617-9650-435c-9fc6-7cdd0ebfb89f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:56 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:56 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:56 devstack sudo[90894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275
Apr 13 17:14:56 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:56 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:56 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 is being set with open permissions: ugo+rw
Apr 13 17:14:56 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:56 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6
Apr 13 17:14:56 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:57 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.429s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:57 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Deleted volume successfully.
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1442d0c5-3b68-4d43-a998-8a645a339732 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-ccecc796-97b7-42d3-8afd-f77c74db1452-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:57 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275" returned: 0 in 0.507s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:57 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275
Apr 13 17:14:57 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:57 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:57 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.info
Apr 13 17:14:57 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:57 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-2188e1fa-eb62-4789-8976-119082441275" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-2188e1fa-eb62-4789-8976-119082441275" released by "delete_volume" :: held 0.935s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Created reservations ['e29df108-905c-4688-a256-178e4aaedd14', 'd62ad0b6-3934-4582-a208-5075b48f5816', '296f5565-7f5f-4ec6-9168-404bbaaba685', '32bd9c43-e1c4-4643-9967-68515fe145e6'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:57 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.info" returned: 0 in 0.441s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:57 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.info is being set with open permissions: ugo+rw
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:57 devstack sudo[90945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:57 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:57 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.info
Apr 13 17:14:57 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-quobyte-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bd04cc-46fd-4d9d-a21d-de8cf2702f98]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:57 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:57 devstack sudo[90949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225
Apr 13 17:14:57 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (e41be193-5d33-476d-9538-927bc0fe5daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47192e37-dcba-4099-b71d-b27186b81242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47192e37-dcba-4099-b71d-b27186b81242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1392030083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3615ed0e043b433a91e085682b691134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:58Z,use_quota=True,user_id='0daa84eac0fc4746b5bf153c62e0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba60a73-c8d1-48e9-a31b-965f49cb9036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba60a73-c8d1-48e9-a31b-965f49cb9036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308fceb7-165e-4320-83f0-c4f864b5c4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (308fceb7-165e-4320-83f0-c4f864b5c4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0', 'volume_name': 'volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b0d750-b544-4751-a506-c117ce9ccf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b0d750-b544-4751-a506-c117ce9ccf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10940fd3-231f-4897-a74b-b39d250374b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:58 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Volume a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0', 'volume_size': 1}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:58 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.496s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Deleted volume successfully.
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9d44262-42c0-4d2d-a8f2-7e02aea638ba tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-2188e1fa-eb62-4789-8976-119082441275-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:58 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.info" returned: 0 in 0.524s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.069s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.462s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Creating offline snapshot b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c of volume 22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:14:58 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7c6be457-fbcd-4901-889e-a669e77b3fca tempest-SnapshotDependencyTests-1289646662 None] Create snapshot completed successfully
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b97b79-dc7f-4f74-af22-6e206f114b5f]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:58 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225" returned: 0 in 0.546s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:58 devstack sudo[90956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443
Apr 13 17:14:58 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:58 devstack sudo[90957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225
Apr 13 17:14:58 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:58 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225" released by "delete_volume" :: held 0.990s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:58 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443" returned: 0 in 0.501s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:58 devstack sudo[90964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c 1G
Apr 13 17:14:58 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created reservations ['65d16e48-d881-49b8-8408-86566362d7bb', '910f042c-424b-45da-a358-78c0c1b638e0', '54cf6820-06f7-45bf-b2a7-e3ff20a67d0a', '73ba3bc5-423e-4e68-8b4d-119b88c0ed00'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:14:58 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:58 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:14:58 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:59 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c 1G" returned: 0 in 0.497s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a253f8-284d-4d28-a90b-78f76c97f443 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:59 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a253f8-284d-4d28-a90b-78f76c97f443 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c
Apr 13 17:14:59 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:59 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:14:59 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Deleted volume successfully.
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-bb37c58f-aa62-4a27-917b-e447ed6d3ea9 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-aa5ff2b1-2c73-421c-8a0b-ff9b8fa14225-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Flow 'volume_create_manager' (3a6f02cc-9b9d-4d5e-9ddd-26c9ea855d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccdde6d-ccaa-4fe2-b94e-0c7d83ce8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ccdde6d-ccaa-4fe2-b94e-0c7d83ce8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0c8d91-de25-49ef-bb70-1e1a72d54b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da79a46c7e0949a9a0a20959574643ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=514aa635-ffaf-4908-9389-364f1ac1bef6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:00Z,use_quota=True,user_id='ca774d0d102944df83a128ff4a1ade07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c29912d-8892-42bc-9ddf-bee3ab4eab36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c29912d-8892-42bc-9ddf-bee3ab4eab36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06b14a9-acf1-49c1-a3f2-cc5413141b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06b14a9-acf1-49c1-a3f2-cc5413141b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df0c8d91-de25-49ef-bb70-1e1a72d54b78', 'volume_name': 'volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78', 'volume_size': 1, 'snapshot_id': '514aa635-ffaf-4908-9389-364f1ac1bef6'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccb55ae-dade-4684-a433-f0b3f3e00220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccb55ae-dade-4684-a433-f0b3f3e00220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433c58e4-2052-47f2-a609-2e155a4e3200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:14:59 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Volume df0c8d91-de25-49ef-bb70-1e1a72d54b78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78', 'volume_size': 1, 'snapshot_id': '514aa635-ffaf-4908-9389-364f1ac1bef6'}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:14:59 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22a253f8-284d-4d28-a90b-78f76c97f443 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" returned: 0 in 0.444s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:14:59 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c is being set with open permissions: ugo+rw
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:59 devstack sudo[90978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c
Apr 13 17:14:59 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-28bdedda-9429-441c-9055-48e039b1e807-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-28bdedda-9429-441c-9055-48e039b1e807-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "cinder-quobyte-28bdedda-9429-441c-9055-48e039b1e807" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-28bdedda-9429-441c-9055-48e039b1e807" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[513cb84b-d0b1-4817-9a8b-7c7e5f44c6e5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:14:59 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:14:59 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807
Apr 13 17:14:59 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:00 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" returned: 0 in 0.466s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:00 devstack sudo[90983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.info
Apr 13 17:15:00 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:00 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807" returned: 0 in 0.469s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:00 devstack sudo[90988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807
Apr 13 17:15:00 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:00 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.info" returned: 0 in 0.403s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:00 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.info is being set with open permissions: ugo+rw
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:00 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.info
Apr 13 17:15:00 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:00 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-28bdedda-9429-441c-9055-48e039b1e807" returned: 0 in 0.443s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-quobyte-28bdedda-9429-441c-9055-48e039b1e807" released by "delete_volume" :: held 0.933s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Created reservations ['54972f1e-a131-4d68-9223-bfe2f1595384', 'cf17d315-bf4d-42e2-b8bf-b76f64f809d7', '1759f9c3-51d8-4600-ba9c-60b404bcf605', 'c7636938-74f0-4043-a614-9f20890f8b56'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:00 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:00 devstack sudo[90994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:00 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:01 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.info" returned: 0 in 0.418s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1392030083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3615ed0e043b433a91e085682b691134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:14:58Z,use_quota=True,user_id='0daa84eac0fc4746b5bf153c62e0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Creating volume a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:01 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-34e771a4-b756-4983-a762-28ea249b6cc7 tempest-CreateVolumesFromSnapshotTest-851651420 None] Create snapshot completed successfully
Apr 13 17:15:01 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 1073741824
Apr 13 17:15:01 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:01 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:01 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Deleted volume successfully.
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5eabb78d-10fb-415d-9a9d-07d3df158070 tempest-CreateVolumesFromSourceVolumeTest-41512646 None] Lock "cinder-28bdedda-9429-441c-9055-48e039b1e807-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:01 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 1073741824" returned: 0 in 0.588s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:01 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:01 devstack sudo[91004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0
Apr 13 17:15:01 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:02 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" returned: 0 in 0.518s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.511s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-quobyte-514aa635-ffaf-4908-9389-364f1ac1bef6-df0c8d91-de25-49ef-bb70-1e1a72d54b78" by "_create_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10940fd3-231f-4897-a74b-b39d250374b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8cee51-b772-46aa-8103-bf1e0face7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-514aa635-ffaf-4908-9389-364f1ac1bef6-df0c8d91-de25-49ef-bb70-1e1a72d54b78" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Creating volume df0c8d91-de25-49ef-bb70-1e1a72d54b78 from snapshot 514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-quobyte-df0c8d91-de25-49ef-bb70-1e1a72d54b78" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Volume volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 (a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0): created successfully
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8cee51-b772-46aa-8103-bf1e0face7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (e41be193-5d33-476d-9538-927bc0fe5daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df0c8d91-de25-49ef-bb70-1e1a72d54b78" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] snapshot: 514aa635-ffaf-4908-9389-364f1ac1bef6, volume: df0c8d91-de25-49ef-bb70-1e1a72d54b78,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4361c982-bf65-48f8-9cfa-65de26b178e5]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:02 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7dfae115-92c4-4bdc-a46f-a8246a6ce795 tempest-VolumeDependencyTests-1409334899 None] Created volume successfully.
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (db4387ef-f1b6-4fbc-886c-cb7ff443678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d58c585-cc33-4a76-835f-852673e0bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d58c585-cc33-4a76-835f-852673e0bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434084991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515f6ab6-78a0-4959-b5c4-f1c16e15dd2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:02Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8710eb55-1f0b-4111-84a9-946910a34e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8710eb55-1f0b-4111-84a9-946910a34e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09eddf5c-c955-4af0-afc9-1a3211f2981b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09eddf5c-c955-4af0-afc9-1a3211f2981b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515f6ab6-78a0-4959-b5c4-f1c16e15dd2b', 'volume_name': 'volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c51ed81-2ec8-4d64-b79a-418a98096d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c51ed81-2ec8-4d64-b79a-418a98096d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f892ce2a-d1c2-4a10-afc4-0ea5cb0c6979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6
Apr 13 17:15:02 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume 515f6ab6-78a0-4959-b5c4-f1c16e15dd2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b', 'volume_size': 1}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (63175e9f-c3b2-40a7-8334-af77061d1f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746d7d2-5def-4dea-a01d-f91fa81701aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746d7d2-5def-4dea-a01d-f91fa81701aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416421812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e8b86c-5e1d-4280-aa18-539e8179b1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:02Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29c39f4-626b-4a0a-a6b2-ffa67071aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29c39f4-626b-4a0a-a6b2-ffa67071aac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523c1842-9327-461f-a60e-74a34b8fc6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523c1842-9327-461f-a60e-74a34b8fc6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e8b86c-5e1d-4280-aa18-539e8179b1a0', 'volume_name': 'volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2deda8b-dce7-4a46-8369-12bb1ea4beb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2deda8b-dce7-4a46-8369-12bb1ea4beb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4fa5fa-215e-4720-86f5-732655de7f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume e8e8b86c-5e1d-4280-aa18-539e8179b1a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0', 'volume_size': 1}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (52bad6dc-febc-46e2-bab5-384cc6b3fd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7063adc5-f87c-415f-b381-b4f551cd25fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7063adc5-f87c-415f-b381-b4f551cd25fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457394484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af00a7-0c40-4ea0-b5b3-101b2acddd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f957ff9-f27f-4f41-b6ca-e08b5938b958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f957ff9-f27f-4f41-b6ca-e08b5938b958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ab9b5-2723-4e29-9900-8c1a0d867af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9ab9b5-2723-4e29-9900-8c1a0d867af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0af00a7-0c40-4ea0-b5b3-101b2acddd34', 'volume_name': 'volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1574891-4c1d-43d8-843e-b470f67fae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1574891-4c1d-43d8-843e-b470f67fae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ed211c-0f8e-4207-b931-d164bb9f0fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume f0af00a7-0c40-4ea0-b5b3-101b2acddd34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34', 'volume_size': 1}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (926b12fb-21a6-48df-b0b0-281eb30f096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a72b312-187a-4130-bf7d-5cdddc96f971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a72b312-187a-4130-bf7d-5cdddc96f971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230507156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f4e027-977c-4af4-8e51-9fd64988ec89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f144612-932b-4d63-91bf-d90c233d3064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f144612-932b-4d63-91bf-d90c233d3064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83070e0f-defa-41a1-9742-9e1656d1466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83070e0f-defa-41a1-9742-9e1656d1466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f4e027-977c-4af4-8e51-9fd64988ec89', 'volume_name': 'volume-03f4e027-977c-4af4-8e51-9fd64988ec89', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974d7f97-058b-4e41-a196-9be33d741cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974d7f97-058b-4e41-a196-9be33d741cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d156ae1c-40a2-4229-b121-20620805f4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:02 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume 03f4e027-977c-4af4-8e51-9fd64988ec89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f4e027-977c-4af4-8e51-9fd64988ec89', 'volume_size': 1}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:02 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6" returned: 0 in 0.684s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d041b8d-2594-4fdf-8fd0-28cfca7d45fb]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Flow 'volume_create_manager' (f01977be-9f5b-46a0-a307-04b96fc0076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a28a4f2-4243-40ee-99c1-a3aec2bd6a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a28a4f2-4243-40ee-99c1-a3aec2bd6a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34a89af-fb59-40e5-b0ed-dd94c5713604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b0f248f86474cb63d49c0658d7b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='fe9be6c3fa394db18018efde13965d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bfb003-8752-4d3e-9bcc-a4dcab9ce60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bfb003-8752-4d3e-9bcc-a4dcab9ce60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbfccf4-3b67-41f3-87d5-b7e6583fcefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbfccf4-3b67-41f3-87d5-b7e6583fcefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34a89af-fb59-40e5-b0ed-dd94c5713604', 'volume_name': 'volume-b34a89af-fb59-40e5-b0ed-dd94c5713604', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1
Apr 13 17:15:03 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70404e4-2bf3-4c0d-8073-7964fb6f978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70404e4-2bf3-4c0d-8073-7964fb6f978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59125f9e-9175-4c77-85eb-40a7e9d73e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Volume b34a89af-fb59-40e5-b0ed-dd94c5713604: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34a89af-fb59-40e5-b0ed-dd94c5713604', 'volume_size': 1}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (38c536f9-6ad5-4435-8f1f-c7cfd209bb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca77c67-5292-47ad-b23f-adec2546bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca77c67-5292-47ad-b23f-adec2546bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506073382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232c3d80-6885-4886-90d4-aa419edf398b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d23f65-6dbd-40bd-bc6f-b2688a41f05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d23f65-6dbd-40bd-bc6f-b2688a41f05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3053b489-4f4f-4ce1-92f2-eabf2d1c6df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3053b489-4f4f-4ce1-92f2-eabf2d1c6df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232c3d80-6885-4886-90d4-aa419edf398b', 'volume_name': 'volume-232c3d80-6885-4886-90d4-aa419edf398b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d631178b-1848-4e9f-a585-1aea45fd87b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d631178b-1848-4e9f-a585-1aea45fd87b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14636c09-7708-4941-972a-8dd57d040f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume 232c3d80-6885-4886-90d4-aa419edf398b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232c3d80-6885-4886-90d4-aa419edf398b', 'volume_size': 1}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (3419a5c8-99c0-4cd3-928b-c12ae3756e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b20f65-dab4-4423-84e5-5c03a0a337f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1" returned: 0 in 0.571s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b20f65-dab4-4423-84e5-5c03a0a337f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1670644168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa5ac24-30eb-40a9-b715-7284628fdcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3615ed0e043b433a91e085682b691134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:04Z,use_quota=True,user_id='0daa84eac0fc4746b5bf153c62e0ce9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5bddbe-dca3-4b48-9532-faef30f11263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5bddbe-dca3-4b48-9532-faef30f11263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3ff2d7-2d77-4fa3-9eab-5669f21b805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3ff2d7-2d77-4fa3-9eab-5669f21b805c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1aa5ac24-30eb-40a9-b715-7284628fdcff', 'volume_name': 'volume-1aa5ac24-30eb-40a9-b715-7284628fdcff', 'volume_size': 1, 'source_volid': 'a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d939ec-e11c-4e95-9fb8-b11604c4de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d939ec-e11c-4e95-9fb8-b11604c4de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:03 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78
Apr 13 17:15:03 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1cc4af-50c1-46ca-bc92-64f3501aab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:03 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Volume 1aa5ac24-30eb-40a9-b715-7284628fdcff: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1aa5ac24-30eb-40a9-b715-7284628fdcff', 'volume_size': 1, 'source_volid': 'a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0', 'source_volstatus': 'available'}
Apr 13 17:15:03 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:05 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78" returned: 0 in 1.829s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:05 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5720a80-e11f-4415-9fc4-12eada31cb94]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:05 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1
Apr 13 17:15:05 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:05 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1" returned: 0 in 0.554s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:05 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1, size 1024.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:15:05 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Converted 1024.00 MB image at 559.78 MB/s
Apr 13 17:15:05 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 is being set with open permissions: ugo+rw
Apr 13 17:15:05 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:06 devstack sudo[91035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78
Apr 13 17:15:06 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:06 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78" returned: 0 in 0.386s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df0c8d91-de25-49ef-bb70-1e1a72d54b78" released by "_copy_volume_from_snapshot" :: held 4.122s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-514aa635-ffaf-4908-9389-364f1ac1bef6-df0c8d91-de25-49ef-bb70-1e1a72d54b78" released by "_create_volume_from_snapshot" :: held 4.160s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.192s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.994s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434084991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515f6ab6-78a0-4959-b5c4-f1c16e15dd2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:02Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Creating volume 515f6ab6-78a0-4959-b5c4-f1c16e15dd2b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:06 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:06 devstack sudo[91038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b 1073741824
Apr 13 17:15:06 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433c58e4-2052-47f2-a609-2e155a4e3200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78', 'volume_size': 1, 'snapshot_id': '514aa635-ffaf-4908-9389-364f1ac1bef6'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5b9ad5-eef2-4eb4-a63f-7a80b89fc5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:06 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Volume volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 (df0c8d91-de25-49ef-bb70-1e1a72d54b78): created successfully
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5b9ad5-eef2-4eb4-a63f-7a80b89fc5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Flow 'volume_create_manager' (3a6f02cc-9b9d-4d5e-9ddd-26c9ea855d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:06 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e01d9ec2-1025-4376-82ec-8b1fbab40560 tempest-SnapshotDependencyTests-1289646662 None] Created volume successfully.
Apr 13 17:15:06 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b 1073741824" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:06 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:06 devstack sudo[91043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b
Apr 13 17:15:06 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-514aa635-ffaf-4908-9389-364f1ac1bef6-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-514aa635-ffaf-4908-9389-364f1ac1bef6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-quobyte-df1136fe-4209-4fd4-ac92-4cfcab248ad1" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df1136fe-4209-4fd4-ac92-4cfcab248ad1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-quobyte-514aa635-ffaf-4908-9389-364f1ac1bef6" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-514aa635-ffaf-4908-9389-364f1ac1bef6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Deleting offline snapshot 514aa635-ffaf-4908-9389-364f1ac1bef6 of volume df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] snapshot_file for this snap is: volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d424927-77c5-4eb1-af00-bd79240edad8]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:07 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.705s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416421812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e8b86c-5e1d-4280-aa18-539e8179b1a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:02Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Creating volume e8e8b86c-5e1d-4280-aa18-539e8179b1a0 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:07 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:07 devstack sudo[91046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6
Apr 13 17:15:07 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f892ce2a-d1c2-4a10-afc4-0ea5cb0c6979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:07 devstack sudo[91047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0 1073741824
Apr 13 17:15:07 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b981fd3-e11b-4a16-938d-c471a813def3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:07 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b (515f6ab6-78a0-4959-b5c4-f1c16e15dd2b): created successfully
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b981fd3-e11b-4a16-938d-c471a813def3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (db4387ef-f1b6-4fbc-886c-cb7ff443678e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:07 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8b3c4e65-f038-4716-a42a-c6aad662b579 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created volume successfully.
Apr 13 17:15:07 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f214d9-3ecc-42b6-aa0c-03004f0ec9b1]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:07 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0 1073741824" returned: 0 in 0.475s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:07 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:07 devstack sudo[91057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0
Apr 13 17:15:07 devstack sudo[91057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:07 devstack sudo[91056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1
Apr 13 17:15:07 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:08 devstack sudo[91057]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0" returned: 0 in 0.386s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.367s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457394484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af00a7-0c40-4ea0-b5b3-101b2acddd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Creating volume f0af00a7-0c40-4ea0-b5b3-101b2acddd34 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:08 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:08 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1" returned: 0 in 0.471s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:08 devstack sudo[91064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34 1073741824
Apr 13 17:15:08 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4fa5fa-215e-4720-86f5-732655de7f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56245ecd-e3f1-4030-8295-1f89bf78c6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:08 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6
Apr 13 17:15:08 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:08 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0 (e8e8b86c-5e1d-4280-aa18-539e8179b1a0): created successfully
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56245ecd-e3f1-4030-8295-1f89bf78c6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (63175e9f-c3b2-40a7-8334-af77061d1f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:08 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-738d0bc8-49fd-4335-99a8-4356345ac33f tempest-CreateVolumesFromSnapshotTest-851651420 None] Created volume successfully.
Apr 13 17:15:08 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6" returned: 0 in 0.446s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:08 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6
Apr 13 17:15:08 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:08 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34 1073741824" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:08 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:08 devstack sudo[91076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34
Apr 13 17:15:08 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:09 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1.514aa635-ffaf-4908-9389-364f1ac1bef6" returned: 0 in 0.388s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-514aa635-ffaf-4908-9389-364f1ac1bef6" released by "_delete_snapshot" :: held 1.840s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df1136fe-4209-4fd4-ac92-4cfcab248ad1" released by "delete_snapshot" :: held 1.854s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Created reservations ['3b14df7a-c69c-4fee-8975-e7fbc8fa448a', 'd2a36e1e-ac5a-4430-94f0-46e1734b6074', 'c4b0ea8d-b030-4986-9c70-f31b34eaa89b', '3f96f461-7a76-4dcb-b3e0-6033c56eb3fe'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:09 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34" returned: 0 in 0.413s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.114s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-230507156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f4e027-977c-4af4-8e51-9fd64988ec89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Creating volume 03f4e027-977c-4af4-8e51-9fd64988ec89 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:09 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ed211c-0f8e-4207-b931-d164bb9f0fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4bc44b-323e-498e-a409-dfff9549dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:09 devstack sudo[91080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89 1073741824
Apr 13 17:15:09 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:09 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34 (f0af00a7-0c40-4ea0-b5b3-101b2acddd34): created successfully
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4bc44b-323e-498e-a409-dfff9549dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (52bad6dc-febc-46e2-bab5-384cc6b3fd16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-65f525db-b450-46d1-b4a3-5308bc47c546 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created volume successfully.
Apr 13 17:15:09 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Delete snapshot completed successfully.
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-23566db6-62cb-4ab3-ad3f-d30cba3594a1 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-514aa635-ffaf-4908-9389-364f1ac1bef6-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-df1136fe-4209-4fd4-ac92-4cfcab248ad1-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-df1136fe-4209-4fd4-ac92-4cfcab248ad1-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-quobyte-df1136fe-4209-4fd4-ac92-4cfcab248ad1" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df1136fe-4209-4fd4-ac92-4cfcab248ad1" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[5114f52e-912e-402f-9b42-8eaac7f04de6]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:09 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1
Apr 13 17:15:09 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:09 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89 1073741824" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:09 devstack sudo[91088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89
Apr 13 17:15:09 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:09 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:09 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:09 devstack sudo[91093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1
Apr 13 17:15:09 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:10 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89" returned: 0 in 0.388s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.943s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34a89af-fb59-40e5-b0ed-dd94c5713604,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b0f248f86474cb63d49c0658d7b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='fe9be6c3fa394db18018efde13965d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Creating volume b34a89af-fb59-40e5-b0ed-dd94c5713604 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:10 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d156ae1c-40a2-4229-b121-20620805f4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f4e027-977c-4af4-8e51-9fd64988ec89', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:10 devstack sudo[91096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604 1073741824
Apr 13 17:15:10 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405d5d37-ed6a-4ea1-9274-d3f5a89ace60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:10 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume volume-03f4e027-977c-4af4-8e51-9fd64988ec89 (03f4e027-977c-4af4-8e51-9fd64988ec89): created successfully
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405d5d37-ed6a-4ea1-9274-d3f5a89ace60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (926b12fb-21a6-48df-b0b0-281eb30f096a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c8b26a82-21c1-4db3-95dc-0d78a37339aa tempest-CreateVolumesFromSnapshotTest-851651420 None] Created volume successfully.
Apr 13 17:15:10 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df1136fe-4209-4fd4-ac92-4cfcab248ad1" returned: 0 in 0.391s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df1136fe-4209-4fd4-ac92-4cfcab248ad1" released by "delete_volume" :: held 0.923s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Created reservations ['6accb745-b289-49d0-879a-0c5f28d1ae87', '2913094e-27fd-4480-943c-b822bcebfe30', 'fb70f63e-d967-4881-9336-1fbbf3cd23e4', 'de6b9609-2639-4e74-9140-4b7d2479744b'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:10 devstack sudo[91099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:10 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-df0c8d91-de25-49ef-bb70-1e1a72d54b78-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-df0c8d91-de25-49ef-bb70-1e1a72d54b78-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "cinder-quobyte-df0c8d91-de25-49ef-bb70-1e1a72d54b78" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df0c8d91-de25-49ef-bb70-1e1a72d54b78" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4650e46-15c4-4c19-bb14-ec8020c35e6d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:10 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604 1073741824" returned: 0 in 0.501s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:10 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78
Apr 13 17:15:10 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:10 devstack sudo[91105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604
Apr 13 17:15:10 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:10 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:10 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Deleted volume successfully.
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=168,cinder:UPDATE=251,cinder:INSERT=59,cinder:DELETE=23 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-91a51420-a876-4481-ab99-061982ef4956 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-df1136fe-4209-4fd4-ac92-4cfcab248ad1-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:10 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.781s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506073382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232c3d80-6885-4886-90d4-aa419edf398b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cc1f6e02ed401a825d8924452e13ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:03Z,use_quota=True,user_id='352855bb1470478db916352046cdf6b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Creating volume 232c3d80-6885-4886-90d4-aa419edf398b {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:10 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:11 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59125f9e-9175-4c77-85eb-40a7e9d73e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34a89af-fb59-40e5-b0ed-dd94c5713604', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:11 devstack sudo[91113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b 1073741824
Apr 13 17:15:11 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b4f0bd-f9ad-4b44-9da6-9b3c076b4ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:11 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78" returned: 0 in 0.509s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Volume volume-b34a89af-fb59-40e5-b0ed-dd94c5713604 (b34a89af-fb59-40e5-b0ed-dd94c5713604): created successfully
Apr 13 17:15:11 devstack sudo[91115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78
Apr 13 17:15:11 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b4f0bd-f9ad-4b44-9da6-9b3c076b4ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Flow 'volume_create_manager' (f01977be-9f5b-46a0-a307-04b96fc0076b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=172,cinder:UPDATE=226,cinder:DELETE=24,cinder:INSERT=49 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:15:11 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-ecd0f1bb-6d2b-46c1-a4b2-174771fa2120 tempest-CinderUnicodeTest-1845248219 None] Created volume successfully.
Apr 13 17:15:11 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-df0c8d91-de25-49ef-bb70-1e1a72d54b78" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-quobyte-df0c8d91-de25-49ef-bb70-1e1a72d54b78" released by "delete_volume" :: held 0.941s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:11 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b 1073741824" returned: 0 in 0.467s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Created reservations ['fc387abf-fe86-494c-9b6b-a5deabaf36e6', '8543e1a1-565d-404f-818c-d3a67c3660a3', '6055dc9b-7d5f-44e5-85ad-98231b21e132', '16d430fa-07a2-4bcf-8f80-0ccd93cc3b23'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:11 devstack sudo[91121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b
Apr 13 17:15:11 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:11 devstack sudo[91123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:11 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82641) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Flow 'volume_create_manager' (8f89013a-bfd8-4c9a-a02a-6ccdd34b16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e78e1e-e0e3-4b95-b0a8-8dfa8f7b1c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e78e1e-e0e3-4b95-b0a8-8dfa8f7b1c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-57339643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eceea13-6bf5-4628-9fbf-aa25f41cc488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b0f248f86474cb63d49c0658d7b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:12Z,use_quota=True,user_id='fe9be6c3fa394db18018efde13965d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f206dd2d-e987-4571-bfc3-cf657356c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f206dd2d-e987-4571-bfc3-cf657356c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:11 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05a5bbd-55f0-4dc1-816e-6a11e9f5c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d05a5bbd-55f0-4dc1-816e-6a11e9f5c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eceea13-6bf5-4628-9fbf-aa25f41cc488', 'volume_name': 'volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb9e167-744f-4aa6-81c9-676f89346990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb9e167-744f-4aa6-81c9-676f89346990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51fec38-37ee-4bf0-a2b8-7d5b5c645f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:11 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Volume 7eceea13-6bf5-4628-9fbf-aa25f41cc488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488', 'volume_size': 1}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b" returned: 0 in 0.488s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.331s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:11 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Cloning volume a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 to volume 1aa5ac24-30eb-40a9-b715-7284628fdcff
Apr 13 17:15:11 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14636c09-7708-4941-972a-8dd57d040f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232c3d80-6885-4886-90d4-aa419edf398b', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d060a00-9b5b-488a-a956-61e92e421181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:12 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Volume volume-232c3d80-6885-4886-90d4-aa419edf398b (232c3d80-6885-4886-90d4-aa419edf398b): created successfully
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d060a00-9b5b-488a-a956-61e92e421181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Flow 'volume_create_manager' (38c536f9-6ad5-4435-8f1f-c7cfd209bb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Creating offline snapshot 9f45ea4f-c483-43ba-9dd2-ccfa46f9683e of volume a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[62180375-c2b8-4660-b0a5-ef5b2bb8b879]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-98e122b1-26f2-46db-978e-26db541a9dc2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created volume successfully.
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:12 devstack sudo[91126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0
Apr 13 17:15:12 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:12 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.581s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:12 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Deleted volume successfully.
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e3a67c2e-82ca-4a63-b5c1-c3e00f96e2f0 tempest-SnapshotDependencyTests-1289646662 None] Lock "cinder-df0c8d91-de25-49ef-bb70-1e1a72d54b78-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_service.periodic_task [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82641) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:12 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" returned: 0 in 0.507s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:12 devstack sudo[91132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:12 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:12 devstack sudo[91134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e 1G
Apr 13 17:15:12 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-232c3d80-6885-4886-90d4-aa419edf398b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:12 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-232c3d80-6885-4886-90d4-aa419edf398b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-232c3d80-6885-4886-90d4-aa419edf398b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-232c3d80-6885-4886-90d4-aa419edf398b" acquired by "delete_volume" :: waited 0.022s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8250977-20ea-4a14-ae41-5815bd600413]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:13 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.561s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-aa833b22-bf04-4c85-b460-a5f85d31f37f None None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:13 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e 1G" returned: 0 in 0.585s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:13 devstack sudo[91141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b
Apr 13 17:15:13 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:13 devstack sudo[91142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e
Apr 13 17:15:13 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:13 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b" returned: 0 in 0.566s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:13 devstack sudo[91151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b
Apr 13 17:15:13 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:13 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" returned: 0 in 0.554s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:13 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e is being set with open permissions: ugo+rw
Apr 13 17:15:13 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:13 devstack sudo[91153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e
Apr 13 17:15:13 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:14 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" returned: 0 in 0.435s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:14 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-232c3d80-6885-4886-90d4-aa419edf398b" returned: 0 in 0.548s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:14 devstack sudo[91158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.info
Apr 13 17:15:14 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-232c3d80-6885-4886-90d4-aa419edf398b" released by "delete_volume" :: held 1.161s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created reservations ['d9fb496e-62d6-44a1-b362-c621d07f527a', 'f2821422-b37d-4b76-8f78-ee042b4c8010', '547bad0c-50ed-48cb-b1a7-bddbc22f231f', 'feb4283d-2ade-4a9a-9f59-62da155a08d4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:14 devstack sudo[91160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:14 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:14 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.info" returned: 0 in 0.485s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:14 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.info is being set with open permissions: ugo+rw
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:14 devstack sudo[91164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.info
Apr 13 17:15:14 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:14 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.421s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:14 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Deleted volume successfully.
Apr 13 17:15:14 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-68415841-5cc7-4f45-92dd-bd13fba58de2 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-232c3d80-6885-4886-90d4-aa419edf398b-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:15 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.info" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-1aa5ac24-30eb-40a9-b715-7284628fdcff" by "_copy_volume_from_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-1aa5ac24-30eb-40a9-b715-7284628fdcff" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] snapshot: 9f45ea4f-c483-43ba-9dd2-ccfa46f9683e, volume: 1aa5ac24-30eb-40a9-b715-7284628fdcff,  {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2e6226-7b70-4db1-950e-124aa55b81db]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-03f4e027-977c-4af4-8e51-9fd64988ec89-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-03f4e027-977c-4af4-8e51-9fd64988ec89-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-03f4e027-977c-4af4-8e51-9fd64988ec89" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:15 devstack sudo[91167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e
Apr 13 17:15:15 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-03f4e027-977c-4af4-8e51-9fd64988ec89" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[41090fcb-a6d4-47c9-8bf2-e4eb755f0da9]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:15 devstack sudo[91169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89
Apr 13 17:15:15 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:15 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" returned: 0 in 0.571s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Creating direct copy from snapshot {{(pid=82641) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[b822cbdc-51cd-48c9-a51b-f27d69d95a11]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:15 devstack sudo[91178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0
Apr 13 17:15:15 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:15 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89" returned: 0 in 0.536s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:15 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:15 devstack sudo[91180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89
Apr 13 17:15:15 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:16 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" returned: 0 in 0.589s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG cinder.utils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Path /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff not found in is_blk_device check {{(pid=82641) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:16 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-03f4e027-977c-4af4-8e51-9fd64988ec89" returned: 0 in 0.538s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:16 devstack sudo[91186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff
Apr 13 17:15:16 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-03f4e027-977c-4af4-8e51-9fd64988ec89" released by "delete_volume" :: held 1.096s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created reservations ['962bbfbd-f971-44c0-bb3d-52756aadafb0', 'f36e4d9a-0d42-4f39-9c10-2c52a04612a2', 'f7ab2b89-9b2f-468d-8a0f-824f58d0ae4c', 'd447e9fa-b5ba-46e9-87cd-c261d92d1bea'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:16 devstack sudo[91188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:16 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:16 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.547s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:16 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Deleted volume successfully.
Apr 13 17:15:16 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-1298dc62-a4ad-48cd-8027-c313eb007e02 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-03f4e027-977c-4af4-8e51-9fd64988ec89-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-f0af00a7-0c40-4ea0-b5b3-101b2acddd34-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-f0af00a7-0c40-4ea0-b5b3-101b2acddd34-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-f0af00a7-0c40-4ea0-b5b3-101b2acddd34" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:17 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-f0af00a7-0c40-4ea0-b5b3-101b2acddd34" acquired by "delete_volume" :: waited 0.026s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:17 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a99f8-fa1f-4eec-a08d-5f83ee7ee9c9]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:17 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:17 devstack sudo[91202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34
Apr 13 17:15:17 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:18 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff" returned: 0 in 2.125s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:18 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc93c39-3782-4fab-87d7-9801f24acdff]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:18 devstack sudo[91204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0
Apr 13 17:15:18 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:18 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34" returned: 0 in 0.988s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:18 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:18 devstack sudo[91209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34
Apr 13 17:15:18 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:19 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" returned: 0 in 0.674s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.image.image_utils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Image conversion details: src /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff {{(pid=82641) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 13 17:15:19 devstack cinder-volume[82641]: INFO cinder.image.image_utils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Converted 1024.00 MB image at 481.61 MB/s
Apr 13 17:15:19 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff is being set with open permissions: ugo+rw
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:19 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff
Apr 13 17:15:19 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:19 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-f0af00a7-0c40-4ea0-b5b3-101b2acddd34" returned: 0 in 0.542s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-f0af00a7-0c40-4ea0-b5b3-101b2acddd34" released by "delete_volume" :: held 1.571s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Created reservations ['81348208-8706-412e-a067-6b8c0e1f545e', 'd689f044-5559-4617-b562-9a93eb2d7e06', '2fb03941-3761-445e-99df-68848f96a11c', 'd650c193-4fb9-4375-a6a6-74490190cd79'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:19 devstack sudo[91218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:19 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:19 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff" returned: 0 in 0.464s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-1aa5ac24-30eb-40a9-b715-7284628fdcff" released by "_copy_volume_from_snapshot" :: held 4.474s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Deleting offline snapshot 9f45ea4f-c483-43ba-9dd2-ccfa46f9683e of volume a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] snapshot_file for this snap is: volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[407762cc-ec3e-408c-9258-7fb45921ff19]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:19 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:19 devstack sudo[91222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e
Apr 13 17:15:19 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:19 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Deleted volume successfully.
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-5916d205-5d60-42b0-bb11-6520194e943e tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-f0af00a7-0c40-4ea0-b5b3-101b2acddd34-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-e8e8b86c-5e1d-4280-aa18-539e8179b1a0-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-e8e8b86c-5e1d-4280-aa18-539e8179b1a0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-e8e8b86c-5e1d-4280-aa18-539e8179b1a0" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-e8e8b86c-5e1d-4280-aa18-539e8179b1a0" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58ff4a8-e647-49ea-9f8e-8b5c940a5450]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:19 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:19 devstack sudo[91224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0
Apr 13 17:15:19 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:20 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cffb479-715a-4992-85b1-38e9aaac56fa]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:20 devstack sudo[91229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0
Apr 13 17:15:20 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:20 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:20 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0
Apr 13 17:15:20 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:20 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:20 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e
Apr 13 17:15:20 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:20 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-e8e8b86c-5e1d-4280-aa18-539e8179b1a0" returned: 0 in 0.438s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-e8e8b86c-5e1d-4280-aa18-539e8179b1a0" released by "delete_volume" :: held 0.910s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created reservations ['17a56bd6-eade-4e03-b00d-5c4f83d2c194', 'ea099e85-432f-4071-9845-978bacd836e1', 'ade74173-a881-464d-a065-d741ac092b24', '7c206fb9-fcef-47e2-af05-0d9609b2bab4'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:20 devstack sudo[91242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:20 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[efde5457-6c66-46be-bba5-f7d58c4e4756]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:20 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:20 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b
Apr 13 17:15:20 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:21 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" returned: 0 in 0.498s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:21 devstack sudo[91249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e
Apr 13 17:15:21 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:21 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.416s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Deleted volume successfully.
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7028d90a-ea43-4465-92d1-c4f033f29bd6 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-e8e8b86c-5e1d-4280-aa18-539e8179b1a0-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:21 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b" returned: 0 in 0.508s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:21 devstack sudo[91256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b
Apr 13 17:15:21 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:21 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0.9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" returned: 0 in 0.394s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-9f45ea4f-c483-43ba-9dd2-ccfa46f9683e" released by "_delete_snapshot" :: held 1.858s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.490s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.499s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6fd313fa30>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-13T15:15:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-57339643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eceea13-6bf5-4628-9fbf-aa25f41cc488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b0f248f86474cb63d49c0658d7b24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T15:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T15:15:12Z,use_quota=True,user_id='fe9be6c3fa394db18018efde13965d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29bddace-ad35-4ede-a5ff-84e90bd81f00),volume_type_id=29bddace-ad35-4ede-a5ff-84e90bd81f00)}" {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Creating volume 7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Selected osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5 as target Quobyte volume. {{(pid=82641) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 13 17:15:21 devstack cinder-volume[82641]: INFO cinder.volume.drivers.remotefs [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] casted to osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 1073741824 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:21 devstack sudo[91258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 1073741824
Apr 13 17:15:21 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1cc4af-50c1-46ca-bc92-64f3501aab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa5ac24-30eb-40a9-b715-7284628fdcff', 'volume_size': 1, 'source_volid': 'a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0', 'source_volstatus': 'available'}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a41b3b0-0e01-4fa5-a7c2-ab3454a1f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:21 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Volume volume-1aa5ac24-30eb-40a9-b715-7284628fdcff (1aa5ac24-30eb-40a9-b715-7284628fdcff): created successfully
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a41b3b0-0e01-4fa5-a7c2-ab3454a1f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Flow 'volume_create_manager' (3419a5c8-99c0-4cd3-928b-c12ae3756e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:21 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d38284d1-30ad-4f5c-a447-92dd67b1d0b3 tempest-VolumeDependencyTests-1409334899 None] Created volume successfully.
Apr 13 17:15:21 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b" returned: 0 in 0.452s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b" released by "delete_volume" :: held 0.980s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created reservations ['d7189247-5273-4daa-ab71-5f6a1043c779', 'c5a20b04-49a1-4892-800b-0bed040a33de', 'fe98ab26-d598-439a-82e6-6125abd68cae', 'afa1edcd-025d-4263-92e5-076027c1b4af'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:21 devstack sudo[91265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:21 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:21 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 1073741824" returned: 0 in 0.484s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:21 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:22 devstack sudo[91267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488
Apr 13 17:15:22 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:22 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.388s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Deleted volume successfully.
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-eb86d514-e1e0-4a03-8a92-211aae1d2192 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-515f6ab6-78a0-4959-b5c4-f1c16e15dd2b-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:22 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488" returned: 0 in 0.431s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'} {{(pid=82641) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51fec38-37ee-4bf0-a2b8-7d5b5c645f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488', 'volume_size': 1}' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4262ad-542b-45eb-987c-d7984f8dc6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 13 17:15:22 devstack cinder-volume[82641]: INFO cinder.volume.flows.manager.create_volume [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Volume volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 (7eceea13-6bf5-4628-9fbf-aa25f41cc488): created successfully
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4262ad-542b-45eb-987c-d7984f8dc6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82641) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Flow 'volume_create_manager' (8f89013a-bfd8-4c9a-a02a-6ccdd34b16f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82641) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 13 17:15:22 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-f28c7d88-ccb7-4019-943e-d07c0dca544f tempest-CinderUnicodeTest-1845248219 None] Created volume successfully.
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[8255bf2b-705f-4c3f-b638-1ea2ce1f179d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:22 devstack sudo[91271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0
Apr 13 17:15:22 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-22a253f8-284d-4d28-a90b-78f76c97f443" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-22a253f8-284d-4d28-a90b-78f76c97f443" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:22 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Deleting offline snapshot b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c of volume 22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] snapshot_file for this snap is: volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a3ba7b-0b4e-4351-95e3-f0f46b518200]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:23 devstack sudo[91273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c
Apr 13 17:15:23 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:23 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" returned: 0 in 0.474s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:23 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0
Apr 13 17:15:23 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:23 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" returned: 0 in 0.473s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22a253f8-284d-4d28-a90b-78f76c97f443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a228265-d815-45ec-89c0-cc346dd75306]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:23 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" returned: 0 in 0.426s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0" released by "delete_volume" :: held 0.931s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:23 devstack sudo[91284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443
Apr 13 17:15:23 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Created reservations ['67022f91-a83b-441b-8853-2af160ce5240', '97df81f2-a8ac-4e3d-a35f-b9a5e8e08532', '7f82c9a7-1157-47f0-ab18-929e4cf93e40', 'fdb7aabb-cd42-40fc-8aa5-0f4fbab0f5a9'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Creating offline snapshot 960ec2b2-c8da-4265-b8b5-32bcc1d47f19 of volume 7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d24eb-0d81-484f-ba67-3d0e10fd6c7d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:23 devstack sudo[91286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:23 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-1aa5ac24-30eb-40a9-b715-7284628fdcff-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-1aa5ac24-30eb-40a9-b715-7284628fdcff-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:23 devstack sudo[91287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488
Apr 13 17:15:23 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-1aa5ac24-30eb-40a9-b715-7284628fdcff" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-1aa5ac24-30eb-40a9-b715-7284628fdcff" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ed4c17-fc8f-4587-b3c0-ac017a7184d4]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:23 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:23 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff
Apr 13 17:15:23 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:24 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443" returned: 0 in 0.555s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:24 devstack sudo[91296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c
Apr 13 17:15:24 devstack sudo[91296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:24 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.449s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:24 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Deleted volume successfully.
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-8e7a30fc-5218-49a6-890b-3dfabcfb5044 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-a0ae9ae8-e4a6-4816-b38f-4ba9dae988b0-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:24 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488" returned: 0 in 0.562s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 1G {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:24 devstack sudo[91304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 1G
Apr 13 17:15:24 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:24 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff" returned: 0 in 0.520s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:24 devstack sudo[91306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff
Apr 13 17:15:24 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:24 devstack sudo[91296]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" returned: 0 in 0.451s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:24 devstack sudo[91311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c
Apr 13 17:15:24 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:24 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 1G" returned: 0 in 0.487s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:24 devstack sudo[91317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19
Apr 13 17:15:24 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:24 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-1aa5ac24-30eb-40a9-b715-7284628fdcff" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-1aa5ac24-30eb-40a9-b715-7284628fdcff" released by "delete_volume" :: held 0.979s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Created reservations ['a04cb10d-845a-4622-8895-0be312eca9c9', '872d19aa-feca-4471-aa83-cc1f161ff87c', '85113f00-6733-4c32-ad29-fe48d28a33b5', 'd488c792-b778-4602-89eb-f901963a0581'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:24 devstack sudo[91320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:24 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:24 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443.b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" returned: 0 in 0.422s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c" released by "_delete_snapshot" :: held 1.967s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:24 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-22a253f8-284d-4d28-a90b-78f76c97f443" released by "delete_snapshot" :: held 1.977s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created reservations ['3962128a-55f8-4ddd-9644-a8fd8861ccef', '76ef301a-760f-48ca-8b93-d6dfea871caf', 'c225ffbc-5a76-4043-8d76-0795281ac8d6', '793a593d-84a6-44b8-bef2-5c7624b03e61'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Delete snapshot completed successfully.
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-c0d88f11-0889-432c-881d-3f8e852bd6e4 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-b2a6fe7c-1c81-4d6d-8394-c8614cb2f07c-delete_snapshot" released by "delete_snapshot" :: held 2.061s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-22a253f8-284d-4d28-a90b-78f76c97f443-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-22a253f8-284d-4d28-a90b-78f76c97f443-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "cinder-quobyte-22a253f8-284d-4d28-a90b-78f76c97f443" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-22a253f8-284d-4d28-a90b-78f76c97f443" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a60e0e9-fbff-4497-93ba-631010feaee7]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:25 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443
Apr 13 17:15:25 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:25 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 -F qcow2 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19" returned: 0 in 0.499s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:25 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 is being set with open permissions: ugo+rw
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:25 devstack sudo[91328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19
Apr 13 17:15:25 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:25 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:25 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Deleted volume successfully.
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cc61345a-26b7-4f39-8c1e-28355fb6ea30 tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-1aa5ac24-30eb-40a9-b715-7284628fdcff-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:25 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443" returned: 0 in 0.468s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:25 devstack sudo[91334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443
Apr 13 17:15:25 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:25 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19" returned: 0 in 0.420s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:25 devstack sudo[91336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.info
Apr 13 17:15:25 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "cinder-quobyte-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:25 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" acquired by "delete_volume" :: waited 0.006s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c43dbef-934a-4938-9d7c-05f6de63b3b3]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:26 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-22a253f8-284d-4d28-a90b-78f76c97f443" returned: 0 in 0.450s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:26 devstack sudo[91339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd
Apr 13 17:15:26 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-quobyte-22a253f8-284d-4d28-a90b-78f76c97f443" released by "delete_volume" :: held 0.951s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Created reservations ['12d1c46c-0158-4f83-a6d7-306f99edc0af', 'c55e90df-ab6c-457a-8d03-8009d5169117', '6445045c-36cc-4b66-b6e7-4b6cc47a273e', 'c8548643-8b17-4994-8a4c-4e6424430147'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:26 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.info" returned: 0 in 0.439s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:26 devstack cinder-volume[82641]: WARNING cinder.volume.drivers.remotefs [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.info is being set with open permissions: ugo+rw
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.info {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:26 devstack sudo[91342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.info
Apr 13 17:15:26 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:26 devstack sudo[91343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:26 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:26 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" returned: 0 in 0.506s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:26 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd
Apr 13 17:15:26 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:26 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.info" returned: 0 in 0.511s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:26 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.522s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Deleted volume successfully.
Apr 13 17:15:26 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-b7353818-19d2-4b25-9b9b-78c707bff19b tempest-CinderUnicodeTest-1845248219 None] Create snapshot completed successfully
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-e7b56914-1d17-4332-851a-f3d10c89a008 tempest-CreateVolumesFromSnapshotTest-851651420 None] Lock "cinder-22a253f8-284d-4d28-a90b-78f76c97f443-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "cinder-960ec2b2-c8da-4265-b8b5-32bcc1d47f19-delete_snapshot" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-960ec2b2-c8da-4265-b8b5-32bcc1d47f19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "cinder-quobyte-7eceea13-6bf5-4628-9fbf-aa25f41cc488" by "delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-7eceea13-6bf5-4628-9fbf-aa25f41cc488" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "cinder-quobyte-960ec2b2-c8da-4265-b8b5-32bcc1d47f19" by "_delete_snapshot" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-960ec2b2-c8da-4265-b8b5-32bcc1d47f19" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Deleting offline snapshot 960ec2b2-c8da-4265-b8b5-32bcc1d47f19 of volume 7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] snapshot_file for this snap is: volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 {{(pid=82641) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a360586-1ba4-4d44-9fab-f59c4a54327c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:26 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:26 devstack sudo[91353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19
Apr 13 17:15:26 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:27 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" returned: 0 in 0.596s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-quobyte-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd" released by "delete_volume" :: held 1.129s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Created reservations ['904d5256-b9dd-4a82-8ed1-cacb8987d56f', 'd3aff2d5-ef89-42ca-a32d-202a075d39ee', '8100aa45-0835-405b-878e-7e33c610e742', '5bc84a72-b697-45ce-b77b-e7b63b0d88fb'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:27 devstack sudo[91356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:27 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:27 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19" returned: 0 in 0.527s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.remotefs [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82641) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a877b-5a90-43cb-810a-fd57bc0c248c]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:27 devstack sudo[91361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488
Apr 13 17:15:27 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:27 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.460s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:27 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Deleted volume successfully.
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-7944ab9f-d5e9-4139-a915-8a808171e3fb tempest-VolumeDependencyTests-1409334899 None] Lock "cinder-61aa6e9d-dddb-47b3-b41e-30c195d5d9dd-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:27 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488" returned: 0 in 0.457s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:27 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:27 devstack sudo[91367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19
Apr 13 17:15:27 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:28 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19" returned: 0 in 0.525s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:28 devstack sudo[91372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19
Apr 13 17:15:28 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:28 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488.960ec2b2-c8da-4265-b8b5-32bcc1d47f19" returned: 0 in 0.398s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-960ec2b2-c8da-4265-b8b5-32bcc1d47f19" released by "_delete_snapshot" :: held 1.983s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-7eceea13-6bf5-4628-9fbf-aa25f41cc488" released by "delete_snapshot" :: held 1.995s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Created reservations ['c3b32015-b766-4f6e-8558-02d7d1394397', '02bff0ca-6ad5-4a86-8b35-7c3530a2ed27', '2783a4c5-05c5-4871-920a-527ba97ab57a', '2f8b55c2-598f-4304-bbbb-582974674b7f'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:28 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Delete snapshot completed successfully.
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-926745bd-f641-4e51-9dc7-0f1ded63da3f tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-960ec2b2-c8da-4265-b8b5-32bcc1d47f19-delete_snapshot" released by "delete_snapshot" :: held 2.081s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "cinder-7eceea13-6bf5-4628-9fbf-aa25f41cc488-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-7eceea13-6bf5-4628-9fbf-aa25f41cc488-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "cinder-quobyte-7eceea13-6bf5-4628-9fbf-aa25f41cc488" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:28 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-7eceea13-6bf5-4628-9fbf-aa25f41cc488" acquired by "delete_volume" :: waited 0.009s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5599693-c761-467b-9fcc-1d3f611cef8d]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:29 devstack sudo[91375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488
Apr 13 17:15:29 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:29 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488" returned: 0 in 0.465s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:29 devstack sudo[91381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488
Apr 13 17:15:29 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:29 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-7eceea13-6bf5-4628-9fbf-aa25f41cc488" returned: 0 in 0.385s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-7eceea13-6bf5-4628-9fbf-aa25f41cc488" released by "delete_volume" :: held 0.882s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Created reservations ['67fda5d2-b45c-4343-af65-e6c5597c73dc', '521e3b52-169c-4c54-975d-dd5b220d41df', 'ca2fe3bd-af0f-459e-909b-d976fba7e0a7', '7a8578df-0999-4a0c-896f-8037a02f14fd'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:29 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:29 devstack sudo[91384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:29 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "cinder-b34a89af-fb59-40e5-b0ed-dd94c5713604-delete_volume" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-b34a89af-fb59-40e5-b0ed-dd94c5713604-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "cinder-quobyte-b34a89af-fb59-40e5-b0ed-dd94c5713604" by "delete_volume" {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-b34a89af-fb59-40e5-b0ed-dd94c5713604" acquired by "delete_volume" :: waited 0.007s {{(pid=82641) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG oslo.privsep.daemon [-] privsep: reply[d794d6b4-d4ab-4f32-8674-2dd9b662f914]: (4, 'qcow2') {{(pid=83513) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:30 devstack sudo[91386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604
Apr 13 17:15:30 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:30 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.407s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:30 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Deleted volume successfully.
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-cf9c8a65-40b3-419d-834a-c6a6b631a78d tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-7eceea13-6bf5-4628-9fbf-aa25f41cc488-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:30 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604" returned: 0 in 0.453s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:30 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604
Apr 13 17:15:30 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:30 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:30 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905/volume-b34a89af-fb59-40e5-b0ed-dd94c5713604" returned: 0 in 0.391s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-quobyte-b34a89af-fb59-40e5-b0ed-dd94c5713604" released by "delete_volume" :: held 0.867s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG cinder.quota [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Created reservations ['72d07474-616d-4c28-bc06-13293b3d4d11', 'e27dd1e8-56eb-434e-9133-756caee6e167', '0a84ba15-4bb0-4e8c-8ff8-f36beb34d698', '37a55c4f-aaf1-4907-9fee-b938db94939d'] {{(pid=82641) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5': None} {{(pid=82641) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG cinder.volume.drivers.quobyte [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-afc0bd5b-2626-41a1-a5e8-e38ffbfd1bc5'] {{(pid=82641) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.lockutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82641) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905 {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 13 17:15:31 devstack sudo[91395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905
Apr 13 17:15:31 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 13 17:15:31 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG oslo_concurrency.processutils [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0cc89948abc32b9231943aa303f32905" returned: 0 in 0.448s {{(pid=82641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG cinder.manager [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Notifying Schedulers of capabilities ... {{(pid=82641) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 13 17:15:31 devstack cinder-volume[82641]: INFO cinder.volume.manager [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Deleted volume successfully.
Apr 13 17:15:31 devstack cinder-volume[82641]: DEBUG cinder.coordination [None req-d9e53c11-dc0f-428c-982c-5b80e14ee8e8 tempest-CinderUnicodeTest-1845248219 None] Lock "cinder-b34a89af-fb59-40e5-b0ed-dd94c5713604-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=82641) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 13 17:15:41 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:UPDATE=105,cinder:DELETE=11,cinder:SELECT=66,cinder:INSERT=31 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 13 17:15:41 devstack cinder-volume[82641]: DEBUG dbcounter [-] [82641] Writing DB stats cinder:SELECT=93,cinder:UPDATE=132,cinder:INSERT=31,cinder:DELETE=6 {{(pid=82641) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}